GPT
Let’s build GPT: from scratch, in code, spelled out. - YouTube by Andrej Karpathy
- LearnGPT
- Langauge model = models the sequence of tokens/word and follows how words follow.. and completes the sequence.
- Neural network
- Attention is all you need (Vaswani et al., 2017)
- Generatively Pretrained Tranformer
- Architecture (The Transformer - Model Architecture)
Javascript
New discovery - SolidJS · Reactive Javascript Library
Bubble.io - no code programming. has a Marketplace with “agencies” to purchase services from consultancies. I wonder what other low-code/no-code/SaaS companies have this model.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention Is All You Need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, & R. Garnett (Eds.), Advances in Neural Information Processing Systems (Vol. 30). Curran Associates, Inc. https://proceedings.neurips.cc/paper%5C_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf