Game On! MIT, Allen AI & Microsoft Open-Source a Suite of AI Programming Puzzles

submited by

Style Pass

2021-06-26 18:30:02

A research team from MIT, Allen Institute for AI and Microsoft Research open-sources Python Programming Puzzles (P3), a novel programming challenge suite that captures the essence of puzzles and can be used to teach and evaluate an AI's programming proficiency.

Programming competition problems are pervasive in the AI community. They can be used to evaluate programmers’ abilities to solve artificial tasks as well as to test the limits of state-of-the-art algorithms. A research team from MIT, Allen Institute for AI and Microsoft Research recently introduced Python Programming Puzzles (P3), a novel and open-source collection of programming challenges that capture the essence of puzzles and can be used to teach and evaluate an AI’s programming proficiency.

The proposed puzzles take the form of a Python function with the answer as an argument. The goal is to find an input x that makes the output of the function true, i.e., a valid answer x satisfies f(x) == True. In other words, finding a solution that returns “true” will solve the puzzles.