Mind and Machine Intelligence

Neil D. Lawrence

FinTECHTalents 2018

E S A R I N T U L
O M D P C F B V
H G J Q Z Y X K W

bits/min
billions
2000
6
billion
calculations/s
~100
a billion
a billion
embodiment
20 minutes
5 billion years
15 trillion years

Human Communication

For sale: baby shoes, never worn

Evolved Relationship with Information

New Flow of Information

Evolved Relationship

Evolved Relationship

Figure: Science on Holborn Viaduct, cradling the Centrifugal Governor.

On Governors, James Clerk Maxwell 1868

\[\text{data} + \text{model} \stackrel{\text{compute}}{\rightarrow} \text{prediction}\]

From Model to Decision

\[\text{data} + \text{model} \stackrel{\text{compute}}{\rightarrow} \text{prediction}\]

Deep Learning

Outline of the DeepFace architecture. A front-end of a single convolution-pooling-convolution filtering on the rectified input, followed by three locally-connected layers and two fully-connected layers. Color illustrates feature maps produced at each layer. The net includes more than 120 million parameters, where more than 95% come from the local and fully connected.

Source: DeepFace (Taigman et al., 2014)

Systems Design

  • decomposition
  • data
  • deployment

Thanks!

References

Hilbert, M., López, P., 2011. The world’s technological capcity to store, communicate and compute information. Science 332, 60–65. https://doi.org/10.1126/science.1200970
Taigman, Y., Yang, M., Ranzato, M., Wolf, L., 2014. DeepFace: Closing the gap to human-level performance in face verification, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2014.220