Interesting discussion on GPT-4, memorization and benchmarks : https://old.reddit.com/r/MachineLearning/comments/124eyso/n_openai_may_have_benchmarked_gpt4s_coding/