Apache NiFi Developer (Mid-Level), [Hands-on Individual Contributor]

Role Summary

The Mid-Level Apache NiFi Developer will design, build, and support data ingestion and integration pipelines using Apache NiFi. This role focuses on hands-on flow development, integration with upstream/downstream systems, and collaborating with data, backend, QA, and DevOps teams to deliver reliable, scalable data solutions in an Agile environment.

Key Responsibilities

NiFi Development & Integration

• Develop and maintain NiFi data flows for batch and near–real-time processing.
• Configure processors, controller services, and parameter contexts.
• Integrate NiFi with REST APIs, databases, file systems, and messaging platforms.
• Implement data validation, transformation, routing, and error-handling patterns.

Quality, Performance & Reliability

• Optimize flow performance, throughput, and back-pressure handling.
• Monitor and troubleshoot data flow issues; support defect resolution.
• Ensure flows meet reliability, scalability, and security standards.

Collaboration & Agile Delivery

• Participate in sprint planning, daily stand-ups, reviews, and retrospectives.
• Collaborate with senior NiFi engineers/leads for design reviews and best practices.
• Work closely with QA and DevOps teams to support testing and releases.

Documentation & Governance

• Maintain clear documentation for flows, configurations, and dependencies.
• Follow established standards for naming, versioning, and promotion across environments.

Required Skills & Experience

Technical

• 3–5 years of experience in data engineering or integration roles.
• Hands-on experience with Apache NiFi (flow design, processors, controller services).
• Experience integrating NiFi with REST APIs, relational databases (SQL), and file systems.
• Understanding of data formats (JSON, XML, CSV).
• Familiarity with Linux, scripting basics, and Git-based version control.
• Basic understanding of NiFi security concepts (users, policies, TLS).

Data & Integration

• Experience with data validation, transformation, and exception handling.
• Ability to work with schemas and ensure data quality across pipelines.

Soft Skills

• Strong problem-solving and analytical skills.
• Clear communication and collaboration abilities.
• Comfortable working in Agile / Scrum environments.
• Ability to work effectively with offshore teams and US stakeholders.

Nice to Have

• Exposure to NiFi clustering and high-availability concepts.
• Experience with Kafka or other messaging platforms.
• Familiarity with CI/CD pipelines for NiFi deployments.
• Experience integrating with cloud storage or services (Azure / AWS).
• Basic exposure to custom processor development (Java).