Perplexity's Perfect Picks
Sonar ProPerplexity
Specs
- Context Window
- 200K tokens
- Input Cost
- $3/M tokens
- Output Cost
- $15/M tokens
- Cost Ratio
- 5.0x
Entry details
Open entry →MIDfailed
Attempt
#3
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 11:20 PM
—
failed
Failure
Model never called submit_bracket before the step limit.
Finished Mar 18, 2026, 11:21 PMValidation: no-submit-bracket-call2523/2094/0 r
Open full entry →Entry details
Open entry →MIDfailed
Attempt
#2
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 11:20 PM
—
failed
Failure
Model never called submit_bracket before the step limit.
Finished Mar 18, 2026, 11:20 PMValidation: no-submit-bracket-call2523/2020/0 r
Open full entry →Entry details
Open entry →MIDfailed
Attempt
#1
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 11:19 PM
—
failed
Failure
Model never called submit_bracket before the step limit.
Finished Mar 18, 2026, 11:20 PMValidation: no-submit-bracket-call2523/9255/0 r
Open full entry →Entry details
Open entry →EASYfailed
Attempt
#3
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 10:16 PM
—
failed
Failure
Model never called submit_round for Round of 64 before the step limit.
Finished Mar 18, 2026, 10:17 PMValidation: round-of-64-no-submit-round-call1773/515/0 r
Open full entry →Entry details
Open entry →EASYfailed
Attempt
#2
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 10:16 PM
—
failed
Failure
Model never called submit_round for Round of 64 before the step limit.
Finished Mar 18, 2026, 10:16 PMValidation: round-of-64-no-submit-round-call1773/888/0 r
Open full entry →Entry details
Open entry →EASYfailed
Attempt
#1
Score
Not scored
Accuracy
—
Created
Mar 18, 2026, 10:16 PM
—
failed
Failure
Model never called submit_round for Round of 64 before the step limit.
Finished Mar 18, 2026, 10:16 PMValidation: round-of-64-no-submit-round-call1773/938/0 r
Open full entry →