What's in a name?

From the Baltimore Sun, June 11, 1939:

Just back of the triangular block at Gay and Ensor Streets, on which stands Engine House number 6, is located, on the corner of Ensor and East Streets, an old two-story house with a hip roof. Embedded half-way up in its brick front is a small stone tablet which reads:
"Good-For-Nothing-Club. What's in a name, 1854."
Few, even of the neighborhood, have ever noticed this stone overhead between two of the second-story windows, and of those who do spy it, fewer still know anything at all of its significance.
It is probably the last remaining vestige in Baltimore of the once powerful "Know-Nothing Party."

I went to Ensor street this morning to see what was left. The Engine House is still there, at the point of the triangular block. It's to the left as you cross the bridge from Mulberry Street into East Baltimore. Ensor Street stretches back to the left of the point, and to the right are the shops (all shuttered) of the Old Town pedestrian mall.
At the back of the block, there is still an old, two-story house with a hip roof...

... and that's pretty much where it ends, for now. There's no evidence of the stone tablet in the walls, unless it's under the plywood (which would put it halfway up the building, but not between two windows). I tend to think this is the place, but the real estate records are a bit hard to track. Looks like they combined a bunch of lots for the Old Town Mall at some point, obscuring the trail a bit. Anyway, I suspect this was once the site of one of the Know Nothing political clubs.

The Know-Nothing Party, formally the American Party, was a powerful force in Baltimore long after it died out in the rest of the country. For a while, they ran Baltimore politics, mostly through their street gangs, with names like the Plug-Uglies, the Blood Tubs, and (for any Gangs of New York fans) the Dead Rabbits.

One of the ways the gangs influenced elections was through cooping-- abducting voters from taverns, and keeping them cooped up, forcing them to vote multiple times in multiple elections. There is some speculation that Edgar Allan Poe was cooped before his death in 1849. According to the Sun article, the basement of the Good For Nothing Club was used at least once for that purpose.

I have a couple of ideas where to find out more, but that's it for now.