In this paper I will argue that (principled) attempts to ground a priori knowledge in default reasonable beliefs cannot capture certain common intuitions about what is required for a priori knowledge. I will describe hypothetical creatures who derive complex mathematical truths like Fermat’s last theorem via short and intuitively unconvincing arguments. Many philosophers with foundationalist inclinations will feel that these creatures must lack knowledge because they are unable to justify their mathematical assumptions in terms of the kind of basic facts which can be known without further argument. Yet, I will argue that nothing in the current literature lets us draw a principled distinction between what these creatures are doing and paradigmatic cases of good a priori reasoning (assuming that the latter are to be grounded in default reasonable beliefs). I will consider, in turn, appeals to reliability, coherence, conceptual truth and indispensability and argue that none of these can do the job.