Sr. Data Engineer
Cincinnati, OH 45201 United States
Job Description
Role overview/Day to Day (in your words, not pasted JD):
• PySpark and cloud experience, script snowflake is a bonus. Migrating from Neteeza to snowflake bigger bonus. At least 5 years of experience. They have insights platform called on-demand. Came from a company called market 6 that they acquired. Supply chain inventory data platform. Sits on top of a neteeza backend database. Trying to move off of that legacy hardware. Very similar to oracle. Migrating it to a hybrid data pipeline solutions. On prem and in the cloud. Data mapping and etl logic going on in the neteeza world and writing in onprem pyspark. Curate the data and push the data up to azure. Streamed or synced before snowflake. They will use Snowflake to replace it. Etl from neteeza to onprem with pyspark and pushing up to snowflake. Fact data dimension data. Any type of supply chain how much is in warehouse vs in stores. End users can make better decisions with x amount of product to order. Multiple data pipelines coming into snowflake. Snowflake working as columbus and then going from cincy to columbus or Cleveland to columbus integrating science from other teams. experience with data bricks and pipelines. Databricks and ADF. Pipelines. Nice to have understanding of data warehouse concepts.
Required Skills: Azure,SNOWFLAKE,SQL