Exploration is an integral part of learning dynamics which allows algorithms to search a space of solutions. When many algorithms simultaneously explore. this can lead to counter-intuitive effects. This paper contributes an analysis of the influence that exploration has on a multi-agent system of $Q$ -learners in a famous congestion dilemma. https://mabelandfoxs.shop/product-category/backpack/