stringparsingsql-server-2005street-address

Parse usable Street Address, City, State, Zip from a string


Problem: I have an address field from an Access database which has been converted to SQL Server 2005. This field has everything all in one field. I need to parse out the address's individual sections into their appropriate fields in a normalized table. I need to do this for approximately 4,000 records, and it needs to be repeatable.

Assumptions:

  1. Assume an address in the US (for now)

  2. assume that the input string will sometimes contain an addressee (the person being addressed) and/or a second street address (i.e. Suite B)

  3. states may be abbreviated

  4. zip code could be standard 5 digits or zip+4

  5. there are typos in some instances

UPDATE: In response to the questions posed, standards were not universally followed; I need need to store the individual values, not just geocode and errors means typo (corrected above)

Sample Data:


Solution

  • Update November 2024: These days I'd pass this kind of problem to an LLM like ChatGPT or Claude. Algorithmic processing of this will never be great, but LLMs are very good at figuring out this type of nonsense.

    Original answer below in case you're feeling adventurous.

    I've done a lot of work on this kind of parsing. Because there are errors you won't get 100% accuracy, but there are a few things you can do to get most of the way there, and then do a visual BS test. Here's the general way to go about it. It's not code, because it's pretty academic to write it, there's no weirdness, just lots of string handling.

    (Now that you've posted some sample data, I've made some minor changes)

    1. Work backward. Start from the zip code, which will be near the end, and in one of two known formats: XXXXX or XXXXX-XXXX. If this doesn't appear, you can assume you're in the city, state portion, below.
    2. The next thing, before the zip, is going to be the state, and it'll be either in a two-letter format, or as words. You know what these will be, too -- there's only 50 of them. Also, you could soundex the words to help compensate for spelling errors.
    3. before that is the city, and it's probably on the same line as the state. You could use a zip-code database to check the city and state based on the zip, or at least use it as a BS detector.
    4. The street address will generally be one or two lines. The second line will generally be the suite number if there is one, but it could also be a PO box.
    5. It's going to be near-impossible to detect a name on the first or second line, though if it's not prefixed with a number (or if it's prefixed with an "attn:" or "attention to:" it could give you a hint as to whether it's a name or an address line.

    I hope this helps somewhat.