managedfiletransfer/prefect-managedfiletransfer
managedfiletransfer
The Managed File Transfer appliance built on Prefect.IO. Upload/download files local, SFTP & Cloud.
下载次数: 0状态：社区镜像维护者：managedfiletransfer仓库类型：镜像最近更新：3 天前
让 AI 帮你使用轩辕镜像？ · 展开查看说明 · 点击收起说明
如果你使用 DeepSeek、元宝 AI、Copilot、ChatGPT 等 AI 工具，协助配置轩辕镜像、编写 docker pull 命令、修改 Docker Compose 镜像地址、配置镜像加速、排查镜像拉取失败、分析报错日志等问题，请先让 AI 阅读并遵守轩辕镜像的规则文档。
只需在 AI 对话中先发送下面这句话即可：
请先完整阅读并严格遵守以下文档中的全部规则与要求：
https://xuanyuan.cloud/agents.md
在未充分阅读并理解该文档前，不要生成任何命令、配置、修改建议、故障排查方案或技术回答。后续所有输出都必须严格以该文档中的规范为最高优先级执行。查看 agents.md 用法指南与完整示范。国内用户首推 元宝 AI、DeepSeek 的深度思考模式，不推荐豆包 AI；Cursor 等编辑器可在对话 @ 该链接，或加入 User Rules。 若 AI 无法访问外链，可 打开说明文档 复制全文粘贴。文档会随站点更新，复制内容可能过期，建议定期检查。
Turn a prefect.io server into a managed file transfer solution. UI and Programatic creation of cron style jobs (aka Flows!) to upload and download files easily between servers. Support local, SFTP remotes plus any Cloud storage supported by rclone - so thats aws, azure, google, sharepoint, and https://rclone.org/overview/ out of the box.
Using prefect for managed file transfer means retries, logging, multi node and high availability come as standard - turning prefect into a reliable enterprise ready file transfer solution.
This package is not the fastest solution to move files around, but it prioritises reliability and ease of use, making it an excellent choice for replacing both quick cron job copy scripts and enterprise managed file transfer applicances.
Key features
- Copy and move files between almost any storage system easily.
- Reliable file moving with checksumming, file size checking etc.
- Smart and safe moving - settings to allow/block overwriting and to only copy files if they are new or changed.
- Unzip/Untar compressed folders after downloading them.
- Repath files as you move them.
- Complex filtering and ordering of files - by path, age, size etc. Pattern matching with regular expressions.
- Leverage Prefect.IO built in scheduling and orchestration capabilities:
- Transfer files on complex cron schedules
- notifications on success/failure - slack, email, etc
- Highly available server architecture - database server + multi-node workers and front ends.
- Available as a https://pypi.org/project/prefect-managedfiletransfer/ for integration into existing self hosted and cloud prefect deployments, and as a https://hub.docker.com/r/managedfiletransfer/prefect-managedfiletransfer/tags
Example use cases:
- Once per day SSH into my database server and copy the latest *.bkup file to a central storage location.
- Monitor a local network share directory for new files and automatically upload them to a cloud storage bucket.
- Schedule a weekly job to synchronize files between two remote servers.
- Move log files from a SSH available web server older than 30 days to a cold storage location.
- Copy file yyyy-MM-dd.zip from a remote server, where yyyy-MM-dd matches todays date, to a local directory and then unzip it.
- Download any file in an S3 bucket larger than 1GB and store it in a local directory.
Visit the full docs https://imperialcollegelondon.github.io/prefect-managedfiletransfer.
Installation - docker
Run prefect managed file transfer in a docker container, like an applicance. See https://hub.docker.com/r/managedfiletransfer/prefect-managedfiletransfer/tags
Note this is ephemeral - prefect has lots of docs on how to setup a database server with it.
bash# run prefect server in a self-removing container port-forwarded to your local machine’s 4200 port: docker run --rm -it -p 4200:4200 managedfiletransfer/prefect-managedfiletransfer:latest
Check out the https://github.com/ImperialCollegeLondon/prefect-managedfiletransfer
镜像拉取方式
您可以使用以下命令拉取该镜像。请将 <标签> 替换为具体的标签版本。如需查看所有可用标签版本，请访问 标签列表页面。
轩辕镜像加速拉取命令点我查看更多 prefect-managedfiletransfer 镜像标签
docker pull docker.xuanyuan.run/managedfiletransfer/prefect-managedfiletransfer:<标签>
DockerHub 原生拉取命令
docker pull managedfiletransfer/prefect-managedfiletransfer:<标签>
镜像拉取常见问题
功能
错误码
用户好评
来自真实用户的反馈，见证轩辕镜像的优质服务
oldzhang
运维工程师
Linux服务器
5
"Docker访问体验非常流畅，大镜像也能快速完成下载。"