<h1 id="airflow">Airflow<a aria-hidden="true" class="anchor-heading icon-link" href="#airflow"></a></h1>
<p></p><p></p><div class="portal-container">
<div class="portal-head">
<div class="portal-backlink">
<div class="portal-title">From <span class="portal-text-title">n8n</span></div>
<a href="/wiki/notes/slkwz8wz5k4v565ht5jcrm0" class="portal-arrow">Go to text <span class="right-arrow">→</span></a>
</div>
</div>
<div id="portal-parent-anchor" class="portal-parent" markdown="1">
<div class="portal-parent-fader-top"></div>
<div class="portal-parent-fader-bottom"></div><ul>
<li><a aria-hidden="true" class="block-anchor anchor-heading icon-link" id="^xnxaubd7sqiw" href="#^xnxaubd7sqiw"></a><a class="color-tag" style="--tag-color: #e6daa6;" href="/wiki/notes/o803a2yfn6ed77y4ngdgul4">#similar</a> <a href="/wiki/notes/slkwz8wz5k4v565ht5jcrm0">n8n</a> <a href="/wiki/notes/oost4d3bpyh3alrr84wyy6j">Dagster</a> <a href="/wiki/notes/ntoplz1ephb277ktutqibro">Temporal</a> <a href="/wiki/notes/pl9ptj43nqfbpjdenq89vxt">Prefect</a> <a href="/wiki/notes/bvlf8mSvt3b9PtjtDLwyy">Airflow</a>  </li>
</ul>
</div></div><p></p><p></p>
<ul>
<li><a href="/wiki/notes/s2AA4w4SyPFu44ylTFLQH">instanceOf</a> <a href="/wiki/notes/tu0kr1satl2556ynjeszzi7">Workflow Software</a></li>
</ul>
<h2 id="comparisons">Comparisons<a aria-hidden="true" class="anchor-heading icon-link" href="#comparisons"></a></h2>
<p></p><p></p><div class="portal-container">
<div class="portal-head">
<div class="portal-backlink">
<div class="portal-title">From <span class="portal-text-title">Apache Nifi</span></div>
<a href="/wiki/notes/5jgz2a6u7bqfs46vbtauqlk" class="portal-arrow">Go to text <span class="right-arrow">→</span></a>
</div>
</div>
<div id="portal-parent-anchor" class="portal-parent" markdown="1">
<div class="portal-parent-fader-top"></div>
<div class="portal-parent-fader-bottom"></div><h3 id="nifi-vs-airflow">Nifi vs Airflow<a aria-hidden="true" class="anchor-heading icon-link" href="#nifi-vs-airflow"></a></h3>
<ul>
<li><strong>Language</strong>: Airflow is built using Python, while NiFi is built using Java.</li>
<li><strong>Workflow Definition</strong>: Airflow uses Python scripts to define workflows as DAGs, while NiFi relies on flow-based programming with a drag-and-drop interface.</li>
<li><strong>Data Processing</strong>: Airflow focuses primarily on orchestrating data processing tasks, whereas NiFi is more focused on data movement, routing, and transformation.</li>
<li><strong>Scalability</strong>: Airflow can be scaled horizontally with distributed task execution, while NiFi can scale out using its clustering feature.</li>
<li><strong>Ease of Use</strong>: NiFi’s web-based interface is more user-friendly, especially for non-developers, compared to Airflow’s Python-based workflow definition.</li>
</ul>
</div></div><p></p><p></p>
<hr>
<strong>Backlinks</strong>
<ul>
<li><a href="/wiki/notes/meKMp4lmey92JjyPZSuU7">Flyway</a></li>
<li><a href="/wiki/notes/jufMoE2L6WPKElXz8jhLv">dbt</a></li>
<li><a href="/wiki/notes/zKR4kifve0XasJ0Evrv2G">Flyte</a></li>
<li><a href="/wiki/notes/slkwz8wz5k4v565ht5jcrm0">n8n</a></li>
<li><a href="/wiki/notes/5jgz2a6u7bqfs46vbtauqlk">Apache Nifi</a></li>
</ul>

Airflow

public-notes


Welcome! And beware!  

## Purpose

This vault is the "[[learning-in-public|ar.swyx.learn-in-public]]" part of my Second Brain. If you share some of my interests, please [reach out](https://djradon.github.io)! 

## Contents

- [[t]] my personal wikipedia
- [[idea]] (not necessarily mine)
- Resource Notes, including highlights, thoughts and metadata, for various things:
  - [[ar]] mostly articles, papers and web pages
  - [[book]]
  - [[community]]
  - [[course]]
  - [[event]]
  - [[game]]
  - [[loc]]
  - [[org]]
  - [[user]] 
  - [[prdct]] mostly software products, but also ontologies
  - [[recipe]]
  - [[video]] movies, tv episodes, youtube, etc
- [[vs]]
- [[wanted]]
- Some "Metadata Notes":
  - [[tags]] which may refer to any and multiple (or none) of the above
  - [[c]]: ways to categorize resources
  - [[p]]: ways to assert things about resources (mostly abandoned)

In terms of the [[t.km.zettelkasten]] method, this wiki is a commingling of literature notes with something @Sönke-Ahrens warned about: a "personal Wikipedia or a database" [^1]. 

In terms of [[t.tm.getting-things-done]], it's references, someday-maybe, next actions, and public projects.

## Beware!

This is a cluttered cupboard of jumbled jottings riddled with inaccuracies, confusion, and mistakes.

## What This Is Not

- evergreen-notes/digital-garden: for "synthesized" / original-ish publishable big-idea notes that should evolve over time, props to @andy-matuschak and @maggie-appleton
- blog: for "point-in-time" items to be shared: personal news, articles, etc.
  - e.g., [[ar.substack.carpe-noctem]]


[^1]: [[book.how-to-take-smart-notes]]  