Job title: Specialist Data Developer
Company: Canadian National Railway
Job description: At CN, we work together to move our company-and North America-forward. Be part of our Information & Technology (I&T) team, a critical piece of the engine that keeps us in motion. From enterprise architecture to operational technology, our teams use the agile methodology to automate and digitize our railroad ensuring our operations run optimally and safely and our employees can focus on value-added tasks. You will be able to develop your skills and career in our close-knit, safety-focused culture working together as ONE TEAM. The careers we offer are meaningful because the work we do matters. Join us!
Job Summary
The Specialist, Data Developer is responsible for building, handling, and optimizing data pipelines. The role moves these data pipelines effectively into production for key data and analytics consumers, shapes the enterprise Data as a Service (DaaS) model and delivers on Information and Technology (I&T) business models. Moreover, the incumbent develops best practices and optimizes data pipelines to deliver products and services aligned with business expectations. The position plays a pivotal role in operationalizing data and analytics initiatives, defining and building CN’s data integration and DaaS platform roadmap.
Main Responsibilities
Data Development
· Ensure optimal data delivery architecture and processes are consistent throughout ongoing projects
· Optimize CN’s data architecture to support the next generation of products and data initiatives
· Build, handle, and optimize data pipelines, moving them effectively into production for key data and analytics consumers
· Build data and domain event models, implement business rules, and scalable data pipelines
· Ensure compliance with data governance and security requirements while creating, improving, and operationalizing integrated and reusable data pipelines
· Enable faster data access, integrate data reuse, and improve time-to-solution for data and analytics initiatives
· Integrate analytics and data science results with business processes
· Promote effective data management practices
· Collaborate with Data Science, Reporting, Analytics and other Development teams to build data pipelines, infrastructure and tooling to support business initiatives
· Design and develop Exact, Transfer and Load (ETL) pipelines using multiple sources of data in various formats and deploy them to achieve a high-level of reliability, scalability, and security
Data Design
· Collaborate with stakeholders and architects to model data landscape and define secure data exchange approaches
· Meet with stakeholders to identify fit-for-purpose within CN’s existing data ecosystem and deliver options and agile solutions
· Design and develop processing pipelines that ingest data into Data Hubs
· Provide day-to-day support and technical expertise to both technical and
non-technical teams
· Participate in building data development expertise and framework
· Translate business needs into technical requirements
Data Operations and Quality Assurance
· Use Agile methodologies and development practices to streamline project delivery aligned with goals, timelines, and budgets and for code reviews and testing to develop and deliver data pipelines
· Build monitoring and debugging tools to analyze data pipelines
· Help unify software development and operations seamlessly, efficiently, and cost effectively
· Improve software quality, automate processes, and accelerate software releases
· Develop and implement test plans and scripts for various data quality processes
· Maintain manual and automated test scripts
Working Conditions
The role has standard working conditions in an office environment with a regular workweek from Monday to Friday and is eligible to participate in CN’s flexible work from home policy. Due to the nature of the role, the incumbent must be able to meet tight deadlines, handle pressure, and stress.
Requirements
Experience
Data Development
· Minimum 5 years overall work experience
· Minimum 3 years of experience in a Data Development role, working in different data management disciplines including data integration, modelling, optimization, and quality
· Experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental or multi-departmental data management and analytics initiative
· Experience in translating business requirements into advanced data models able to fulfill Analysts and Data Scientists’ requirements
· Experience working in an Agile team environment
Education/Certification/Designation
· Bachelor’s Degree in Computer Science, Electrical Development or Software Development
· Google or Azure Data Development certification*
*Any designation for these above would be considered as an asset
Competencies
· Inspires others with impactful communications and adapts to the audience through speech and writing
· Applies analytical thinking
· Innovates through problem solving
· Knows the business and stays current with industry trends to elevate expertise and work
· Demonstrates organizational abilities
· Collaborates with key internal stakeholders to enable higher productivity
· Works independently with little supervision
· Technical Skills/Knowledge
· Knowledge of Scala, Java or Python
· Knowledge of software development best practices such as code reviews, testing frameworks, maintainability, and readability
· Expertise with Databricks Delta Lake
· Knowledge of Structured Query Language (SQL) and Non-Structured Query Language (NoSQL) technologies and fluent in writing, executing, and optimizing SQL queries
· Knowledge of Big Data technologies and cloud platforms such as Databricks, Apache Spark, Azure Data Factory, Azure Data Explorer, Azure Data Lake, Google BigQuery, Google Dataproc, Google Cloud Data Fusion, Google Dataflow, Google Cloud Composer, Google, Dataprep, Google Dataplex, Google BigLake, Google Vertex
· Knowledge of event-driven architecture (e.g., Pub-Sub, Kafka, Message Queuing (MQ), Message Queuing Telemetry Transport (MQTT), Advanced Message Queuing Protocol (AMQP), Event Hub, Logstash)
About CN
CN is a world-class transportation leader and trade-enabler. Essential to the economy, to the customers, and to the communities it serves, CN safely transports more than 300 million tons of natural resources, manufactured products, and finished goods throughout North America every year. As the only railroad connecting Canada’s Eastern and Western coasts with the Southern tip of the U.S. through a 19,500 mile rail network, CN and its affiliates have been contributing to community prosperity and sustainable trade since 1919. CN is committed to programs supporting social responsibility and environmental stewardship. At CN, we work as ONE TEAM, focused on safety, sustainability and our customers, providing operational and supply chain excellence to deliver results.
For internal candidates, note that the grade level of the position will depend on the employee’s experience.
CN is an employment equity employer and we encourage all qualified candidates to apply. We thank all applicants for their interest, however, only candidates under consideration will be contacted. Please monitor your email on a regular basis, as communication is primarily made through email.
Expected salary:
Location: Toronto, ON
Job date: Thu, 14 Dec 2023 00:02:39 GMT
