Consultant - Data Engineer

Insygnum needs a Consultant - Data Engineer to help our clients for data analysis, data integration and data quality. Our Chicago-based team is small but growing fast and we need to complement our in-house experts who knows how to tame challenging data. This is a unique opportunity to not only work with cool technology, but also to create a new methodologies and techniques. You'll get in on the ground floor of a new company, help shape its future, and benefit directly from your work.

Why work here

Joining insygnum now offers several unique opportunities
• You will receive competitive salary, benefits, and stock options
• You will be working on hard, interesting problems
• You will help shape the culture of the company as we grow
• You will have the opportunity to apply your skills in a meaningful way and have a real-world impact

Responsibilities

You'll help design a new system for capturing, storing, analyzing, and acting on performance, security, and network data. The ideal candidate will have a solid grasp of several different database and data warehousing technologies to help architect ETL for. Technologies to be used may include some combination of relational databases (PostgreSQL, Teradata, Aster, HANA), NoSQL, Hadoop, Object-based stores, and OLAP.

Specific responsibilities include:
• Help design an architecture for federated data stores and data fusion
• Help design methods for storing data in a way that facilitates extremely fast data parsing and management
• Implement "glue code" that connects middle tier components with backend components
• Implement data management and analytics code utilizing data architecture (e.g. map reduce)
• Collaborate with machine learning folks to determine how to analyze various data sets and set up methods for querying data stores
• Collaborate with data architects to understand the applications we integrate with and the data they produce
• Review requirements for new approaches to big data storage and analytics
• Design methods for caching, paging, and integrating real-time data with historical data stores

Desired Skills and Experience

Requirements

• Development knowledge for integrating components and contributing to core code base - Java preferred
• Solid understanding of database and data warehousing technologies
• Knowledge of SQL as well as NoSQL queries, syntax, and technologies
• Knowledge of big data requirements, applications, and technologies such as Hadoop
• Knowledge of ETL methods and approaches including triggers, named views, temporary tables, etc.
• Linux expertise

Bonus Points

• Java is strongly preferred (e.g. for working with map reduce) but not ultimately a requirement if you excel in other areas
• Strong SQL skills are highly desirable
• OLAP experience
• Experience with ETL tools like Informatica, Boomi, Pentaho, AbIntio, Datastage, etc.,