Software Is Changing

this note is based on the talk given by Andrej Karpathy : https://www.youtube.com/watch?v=LCEmiRjPEtQ&t=385s&ab_channel=YCombinator

Software evolution

• software 1.0 : code - code that we have written so far. (all host in github)
• software 2.0 : weight - basically neural networks. (host in hugging face)
  • you not writing code directly, essentially you just tunning the data sets and running and optimizer to create the parameters of the neural network.
• Software 3.0 : LLM - prompts are now programs that programme the LLM.
  • basically you can write software using english that construct as prompt.

How to think about LLMs ?

• AI is the new electricity
• LLMs have properties of utilities. like electricity grid.

current ear of the LLM

• we are in a era that first computers are created. on that era computers are large machines and power hungry like the super computers that runs the LLMs. so we are using early concepts known as time sharing. we just use some time of the super computer to do our work. soon revolution of the personal computer can be happens to the LLMs also. but still we are not there.

LLM psychology

• LLMs are like human spirits that have good photo graphic knowledge about everything. (things that he is trained)
• another analogy is we can think them like a simulation of a super intelligent autistic persons that have cognitive issues.
• memory of a person can be take as LLMs context window. but human has those memories for some time, but LLMs it get reset every time you start a new chat.

Opportunities

partial autonomy apps.

• we can take cursor as an example.
  • it has an application specific GUI.
  • package state into a context window before calling GUI.
  • orchestrate and call multiple models (embedding models, chat models)
  • Autonomy slider. (you can do inline change, whole file change or whole project change)
  • we can take perplexity as an another example.