Skip to content

n8n v2 queue mode with numpy and pandas. Separate main n8n with task runner and worker then integrate with PostgreSQL and Redis

Notifications You must be signed in to change notification settings

tobing/n8n-v2-with-numpy-pandas

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

n8n v2 with numpy and pandas

n8n v2 queue mode with separate task runner and worker. Integrate with PostgreSQL and Redis.

Rebuild task runner with numpy and pandas using Dockerfile and also enable blocked nodes with NODES_EXCLUDE="[]"

Start

Clone this repo

git clone https://github.com/tobing/n8n-v2-with-numpy-pandas.git
cd n8n-v2-with-numpy-pandas

To start n8n simply start docker-compose by executing the following command in the current folder.

IMPORTANT: Change the default users and passwords in the .env file!

docker compose up -d --build

To stop it execute:

docker-compose stop

Verify if n8n, worker and task runner images are the same version:

docker inspect n8n-main n8n-worker n8n-custom-runner | grep image.version

To access it, open with web browser:

http://localhost:5678

Configuration

The default name of the database, user and password for PostgreSQL and also n8n version can be changed in the .env file in the current directory.

External packages for task runner can be modified with Dockerfile and n8n-task-runners.json inside n8n-custom-runner

Task runner included these external packages:

NODE: moment,uuid,axios,cheerio,form-data,node-fetch,csv-parse

PYTHON: numpy,pandas

To verify the external packages working properly, import n8n-workflow.json from verify-external-modules to n8n then execute workflow.

The workflow has 3 nodes. Manual trigger, Node Modules Test and Python Modules Test.

About

n8n v2 queue mode with numpy and pandas. Separate main n8n with task runner and worker then integrate with PostgreSQL and Redis

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published