I’m a native English speaker and had no issue… but I come across (or hear) contractions like “ain’t” often enough that it barely registers as being non-standard… just much less formal, really. Some punctuation might’ve helped you here.

Let’s go fishing