I asked on Twitter for where to start on considering programming languages as languages. Here are some of the best recommendations:

The work of Yorick Wilks may also be of interest. The Esoteric Codes project that I learned about from this thread is also excellent!

With many thanks to everyone who contributed.