Data Pipelines with Apache Nifi

By |2020-05-14T17:39:36+00:00May 14th, 2020|

Data Pipelines with Apache Nifi Quickly moving new data sources into a Big Data environment is one of the challenges we hear about most from our clients. It's one thing to write some code that gets data from an API and then move it into the data environment, it's another to make it an operational process that the end user (the business) can rely on. This article will look at considerations and lessons learned for using one of Twisted Pair Labs' favorite heavy lifters in this problem space, Apache Nifi. What is Apache Nifi? Apache Nifi is an open source project originally developed by the NSA to manage very large streams of data. [...]