We believe in using the cloud and new tools to handle your data. However, we don't think it's necessary to create a whole new system if you have a specific problem. In this case, we wanted to tackle a specific issue.
Our main goal was to regularly access the raw data from three different DMS systems and securely upload them to our DATA FLOSS environment. Once the data was there, we organized it based on a set standard. This allowed us to have a dataset that we could compare easily.
Next, we set up automated processes. These processes would remove duplicate entries and correct simple errors like phone numbers and postal codes. After this standard transformation, all datasets were automatically converted into a format that marketing tools like mailchimp could use.
It was a simple process: Get the data, organize it, and it's ready to be used.