Text this: The Hofstadter butterfly in finite and infinite systems