Enterprise Data Engineer

Company: Flywheel Digital
Location: Towson
Posted on: August 1, 2020

Job Description:

Who We're Looking For As an Enterprise Data Engineer, yoursquoll be responsible for working to build out and improve the company's data ingestion, transformation, transactional and data warehousing needs directly supporting the data science team. Additionally, you will be responsible for managing cross Ascential Brand data sharing and enterprise data strategies helping to put data standards and practices in place, provide governance to the proper and compliant use of the data by different stakeholders, and being one of the data stewards for the company. This role is essential to help support Flywheelrsquos exponential growth as well as execute on cross Brand initiatives to share and leverage data assets to help drive growth with all Ascential Brands. Responsiveness and willingness to solution new ideas is a key to the success of this position. Willingness to own an issue and see it through to completion is a core competency that will make you successful within Flywheel. This position will require a highly energetic, quick learner, who is looking to be constantly challenged. What You'll Be Doing Lead data engineering for the data science team and act as a conduit back to the core data engineering team Own all data extraction, transformation, and loading of data required for data science projects Can efficiently work with large data sets (1 TB) Setup and optimize all clusters on Qubole based on data science project requirements Assist data science team in Spark code optimization Ability to deploy and implement models developed by data science team Ability to work in a multi-tasking environment. Drive secure solutions that perform well and scale with the organization. Strong point of view on how things should get done Drive standardization on software solutions being implemented for data storage for all ETL processing. Determine the right data strategy for loading data efficiently and accurately Determine the right place for a data source to be stored to be used optimally. Determine where data sets should be loaded for application use or reporting use. Architect the proper data model for Application performance and reporting visualization Oversee data security and best in class data access protection procedures are in place Identify poorly running SQL and make changes to SQL or business process to correct issues Create custom monitoring jobs to keep database performance statistics and project future growth Determine an archive strategy for all data that will encompass a hot, warm, cold data strategy. As it becomes costlier to store data in Red Shift, we need to determine what data should be kept there for fast retrieval and then determine what data needs to be available at a more cost-effective option Troubleshoot and conduct root cause analysis on all data delays and inaccuracies to provide proactive monitoring and automation is in place What you bring to the table Bachelorrsquos Degree, preferably in ITData-related field At least 3 years of experience in Python andor R At least 3 years of SQL experience At least 2 years of AWS or other Cloud technology experience At least 2 years of Qubole experience At least 2 years of Spark experience At least 2 years of Sprint PlanningDevelopment using JIRA Preferred Qualifications At least 6 years of experience in Python andor R At least 6 years of SQL experience At least 5 years of AWS or other Cloud technology experience At least 5 years of Qubole experience At least 5 years of Spark experience At least 3 years of Sprint PlanningDevelopment using JIRA At least 2 years of RedshiftSnowflakeData Warehouse experience At least 2 years of EMR experience At least 2 years of Airflow experience What to expect from us Our benefits package incorporates what wersquore passionate about ndash unlocking your future, overall well-being, and sustainability ndash whilst giving you control over your benefits. Unlimited Paid Time Off 401K ndash Saving Incentive plan Medical and Dental Insurance plans Flexible Spending Accounts Vision benefits Great learning and development opportunities Life Assurance and Disability insurance Option to opt into the Ascential Shares Scheme About Flywheel Flywheel Digital is a diverse collection of practitioners who have solved the most challenging problems for numerous Fortune 500 companies on Amazon. We love rolling up our sleeves to figure out the root cause of issues and implement structural fixes to get and keep our client's business on track. Our team of business managers, search managers, analysts, and software developers work together to provide industry-leading support to the best brands on Amazon. Flywheel are headquartered in Baltimore in the United States and have recently set up a European hub in London. In 2018 Flywheel was acquired by Ascential PLC.

Keywords: Flywheel Digital, Towson , Enterprise Data Engineer, Other , Towson, Maryland