Position: Sr. Big Data Developer Location: NYC, NY Duration: 12+ Months Job Description: The Senior Big Data Developer will bring their expertise in designing and developing highly robust, repeatable and scalable workflow patterns to ingest, integrate and publish a wide variety of data from internal and external sources. They will be relentless in their focus on delivery and end ensuring that our data workflows and pipelines are enterprise-grade reliable, scalable and secure. Responsibilities include: * Designing, implementing, maintaining highly robust, scalable and flexible ETL jobs and data workflows * Automating workflows leveraging DevOps framework where applicable * Ensuring the quality of technical solutions as data moves across all environments * Working with solution and data architects to develop, construct, test and maintain architectures, prototypes and design solutions * Helping to maintain the integrity and security of the company data * Providing insight into the changing data environment, data processing, data storage and utilization requirements for the company and offer suggestions for solutions * Articulating both the technical implications as well as data usage implications of proposed solutions or solution options to a wide variety of stakeholders. * Working directly with business users to align solutions with business requirements * Relentless focus on continuous improvement of solutions to improve data reliability, efficiency, quality and more * Create data monitoring capabilities for each business process and work with data consumers on updates * Collaborating with cross-functional teams comprised of technical and business colleagues Minimum Qualifications: * 3 + years experience in a Big Data Development * Hands-on with developing data pipelines & frameworks * Proficiency in SQL a must - knowledge of SQL and multiple programming languages in order to optimize data processes and retrieval * 5+ years of experience in data programming languages such as Python or Spark * Experience with data warehousing (ODS, data marts, data lakes) * 3+ years of experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc. * 3+ years of experience working in a production cloud infrastructure * Prior backgrounds with AWS services (e.G. Lambda, S3, Aurora, Redshift); * Exposure to CI/CD for software systems * Must be able to develop creative solutions to problems * Demonstrates critical thinking skills with the ability to communicate across functional departments to achieve desired outcomes * Ability to work independently and as part of a team * Skilled in Microsoft Office including Project, PowerPoint, Word, Excel, and Visio * Bachelor s Degree in Computer Engineering or related field Preferred Qualifications: * Hands-on experience in leading healthcare data transformation initiatives from on-premise to cloud deployment * Demonstrated experience working in an Agile environment as a Big Data Developer * Experience with other Cloud Data Warehouses (Big Query, Snowflake); * Knowledge of provider-sponsored health insurance systems/processes and the Healthcare industry * Proficiency with graph and NoSQL databases Guardian Info Group, LLC is an Equal Opportunity Employer. Guardian does not discriminate on the basis of race, color, religion, gender, national origin, age, disability or any other characteristic protected by applicable state or federal civil rights laws. - provided by Dice Associated topics: data analytic, data engineer, data quality, data scientist, etl, erp, mongo database administrator, sql, sybase, teradata
* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.