Portfolio Project

Nonogram Solver

Reinforcement Learning (RL)

Machine Learning Python PyTorch AWS Docker

Generate a new Nonogram puzzle, then watch the agent solve it step-by-step.

  • Click “New Puzzle” to generate a board.
  • Once it’s ready, the button switches to “Solve With AI”. Click it to start solving.
  • Use “Solution” to reveal the full answer key if you want to compare.
  • If AWS is warming up, wait for the status to turn ready and try again.

STAR Summary

Situation
I wanted to see if an RL agent could learn to solve Nonogram puzzles.
Task
Owned the end-to-end build, from implementation through the final deliverable.
Action
  • Generated large batches of 5x5 puzzles and trained a hybrid CNN + Transformer policy network to solve them.
  • Shaped rewards around unique guesses, row/column completions, and full-board solves to guide exploration.
Result
  • Achieved strong solve rates on held-out 5x5 boards (see GitHub for evaluation details).