Explaining neural scaling laws

Yasaman Bahri, E. D., Kaplan, J., Lee, J., & Sharma, U. (2024). Explaining neural scaling laws.

Type

Unclassified

Intellectual base

Unclassified

Year

2024

DOI

10.1073/pnas.2311878121

Link

https://doi.org/10.1073/pnas.2311878121

Cited by

1 citation across 1 artifact.

Domain-specific

• Neural scaling law
  • Fits are regime- and architecture-dependent, extrapolation can fail at data quality or optimization transitions and benchmark contamination or selective reporting can mimic smooth scaling.

Verification

This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.

Registry ID ref:f1137bb1d9c2 · see in the full table