Choosing the Best Model Size and Dataset Size under a Fixed Budget for LLMs | Towards Data Science

A small-scale exploration using Tiny Transformers