Google AI Chief Jeff Dean's ML System Architecture Blueprint


:star: :star:

Notes

5 components of Jeff Dean’s ML System Architecture Blueprint for the future:

  • Large model, but sparsely activated
  • Single model to solve many tasks
  • Dynamically learn and grow pathways through a large model
  • Hardware specialized for ML supercomputing
  • ML for efficient mapping onto hardware