Email: hr@insygnum.com
Phone: (630)-799-1556
Sr. Consultant - Data Engineer
Insygnum needs a Consultant - Data Engineer to help our clients for data analysis, data integration and data quality. Our Chicago-based team is small but growing fast and we need to complement our in-house experts who knows how to tame challenging data. This is a unique opportunity to not only work with cool technology, but also to create a new methodologies and techniques. You'll get in on the ground floor of a new company, help shape its future, and benefit directly from your work.
Why work here
-
Joining insygnum now offers several unique opportunities
- You will receive competitive salary, benefits, and stock options
- You will be working on hard, interesting problems
- You will help shape the culture of the company as we grow
- You will have the opportunity to apply your skills in a meaningful way and have a real-world impact
Responsibilities
- Identify data warehouse needs and develop strategy for implementing a warehousing solution including investigating data sources, rationalizing information sources, identifying technology components, building roadmaps and reference architecture stacks
- Work with Business Analysts and other information management professionals through all phases of project development, from envisioning to architecture definition and end solution realization
- Provide direction and collaborate with Data Engineers to implement enterprise solutions that will support organizational business intelligence and analytics requirements
- Work with the business to identify opportunities where technology can be leveraged to solve existing problems and can assist with new market opportunities
- Meet with technology vendors, convey technical requirements and business use cases, develop scorecards, install vendor products in a lab environment, and summarize findings and results of testing
- Help design an architecture for federated data stores and data fusion
- Help design methods for storing data in a way that facilitates extremely fast data parsing and management
- Implement "glue code" that connects middle tier components with backend components
- Implement data management and analytics code utilizing data architecture (e.g. map reduce)
- Collaborate with machine learning folks to determine how to analyze various data sets and set up methods for querying data stores
- Collaborate with enterprise architects to understand the applications we integrate with and the data they produce
- Review requirements for new approaches to big data storage and analytics
- Design methods for caching, paging, and integrating real-time data with historical data stores
- Minimum ten years of experience in an IT environment with at least five years designing and working with large enterprise database warehouses, designing robust data models and partitioning strategies
- Minimum five years of data architecture experience, including data modeling with project teams, data governance strategy, metadata management, system architecture, design, and implementation
- Minimum five years experience using one or more data integration tools including Data Quality and ETL
- Development knowledge for integrating components and contributing to core code base - Java preferred
- Solid understanding of database and data warehousing technologies
- Experienced in advanced SQL as well as NoSQL queries, syntax, and technologies
- Experienced in big data requirements, applications, and technologies such as Hadoop
- Proficient in ETL methods and approaches including triggers, named views, temporary tables, etc.
- Experienced in Linux environments
- Experience working with IT strategy teams, business teams and business analysts to define information systems, services and management
- Experience with RDBMS including SQL Server, Oracle 11g, MySQL; Big Data including SQL Data Warehouse Appliance, Oracle Exadata, Netezza, Greenplum, Vertica, Teradata, Aster Data, SAP HANA, Hadoop a plus; Analytics including SAS, SPSS, Spotfire, Tableau, Qlikview, R, Oracle Endeca; BI Tools including Oracle OBIEE, SAP Business Objects, SAS and other Analytics Vendors with BI components; ETL & MDM including Informatica, SAS Dataflux, IBM, Siperion, Rochade, Map/Reduce for ETL is a plus
- Java is strongly preferred (e.g. for working with map reduce) but not ultimately a requirement if you excel in other areas
- Strong SQL skills are highly desirable
- OLAP experience
Technologies to be used may include some combination of relational databases (PostgreSQL, Teradata, Aster, HANA), NoSQL, Hadoop, Object-based stores, and OLAP.
-
Specific responsibilities include: