Abhishek Shah is a Senior Data Integration Architect at iOLAP, Inc, specialized in Data Integration solutions. Through his experience and expertise he has become certified on Informatica, DataStage, MPP platforms including Netezza and Teradata as well as cloud technologies like AWS. His experience in a variety of platforms, databases, and the Data Integration suites allow for an easy adaptation of new environments and technologies.

Introduction Every five to six years, there comes a technology wave, and if you are able to catch it, it will take you a long way. Throughout my career, I’ve ridden several of these waves. MPP data warehouses brought us incredible speed for analytics and a few headaches for data integration. We’re seeing in-memory analytics reducing disk latency. Hadoop based technologies are opening up new solutions every day for storage and compute workloads while our source systems are still generating varying degrees of velocity, volume, and variety. As a traditional ETL developer, I would usually try to figure out the