Randy Zwitch • 9/6/2018

Mirroring an FTP Using lftp and cron

This article details a sysadmin/data engineering solution for efficiently mirroring a large (300GB/day) remote FTP dataset to a local VM. It explains the specific lftp mirror command with flags for resilience and parallelism, and shows how to automate the process using a cron job and a simple bash script.

0 comments

#Cron #Data Synchronization #Lftp