docker

Topic Replies Views Activity
Docker compose to run Prefect 2.0 locally with Postgres
Tutorials & Resources
prefect-2-0 ,  local-development ,  docker ,  user-contribution ,  infrastructure ,  postgres ,  docker-compose ,  orion-api-server
0 96 May 14, 2022
CI/CD for Prefect 2.0
DataOps Tutorials for Prefect 2.0
prefect-2-0 ,  deployment ,  ci-cd ,  docker ,  infrastructure ,  environments ,  list-of-resources ,  todo
0 54 May 14, 2022
Can Prefect run each task in a different Docker container?
Deployments & DevOps
prefect-1-0 ,  flow-of-flows ,  docker ,  create_flow_run ,  orchestrator-pattern ,  wait_for_flow_run ,  infrastructure ,  code-dependencies ,  docker-run ,  docker-image ,  base-image
1 339 June 14, 2022
Cloning a Git Repo with Docker ENTRYPOINT for.a Flow Run
Deployments & DevOps
prefect-1-0 ,  docker ,  dockerfile
0 21 June 11, 2022
How to bind mount a volume to a flow run container - for example, mounting a volume with AWS credentials to a Docker agent
Deployments & DevOps
prefect-1-0 ,  prefect-2-0 ,  docker ,  bind-mount ,  to-write
0 28 June 9, 2022
Mounting Volume to DockerRun for Local Storage
Deployments & DevOps
prefect-1-0 ,  cloud-1-0 ,  docker ,  bind-mount ,  volumes ,  host_config
2 83 June 9, 2022
OSError: [Errno 24] "Too many open files" when running a docker agent for some time
User Questions
prefect-1-0 ,  docker ,  docker-agent
12 74 June 6, 2022
Scaling docker flow runners from 0 to N and back? (Google Cloud preferred)
Deployments & DevOps
prefect-2-0 ,  vertex ,  docker ,  gcs
1 47 May 29, 2022
Cloudpickle version mismatch causing errors
Deployments & DevOps
docker ,  cloudpickle
1 326 May 20, 2022
Packaging code dependencies with GCP and GitHub actions for Prefect 2.0 - by Benny Warlick
Tutorials & Resources
prefect-2-0 ,  ci-cd ,  gcp ,  docker ,  user-contribution ,  gcr
0 36 May 13, 2022
Can I run a Docker agent in a container?
Deployments & DevOps
prefect-1-0 ,  docker ,  agent ,  docker-agent
0 164 January 23, 2022
How to package dependencies into a Docker image and push those to AWS ECR?
Deployments & DevOps
prefect-1-0 ,  aws ,  docker ,  ecr ,  docker-image
0 77 April 22, 2022
Can you recommend some repository structure to separate code dependencies between separate Prefect projects?
Deployments & DevOps
prefect-2-0 ,  ci-cd ,  docker ,  dockerfile ,  code-dependencies ,  docker-image
0 80 April 22, 2022
How to package a common task library into a Docker image and use it in my run configuration
Deployments & DevOps
prefect-1-0 ,  docker ,  github-storage ,  docker-run
1 71 April 14, 2022
Unable to use DockerFlowRunner when using Prefect 2.0 in WSL 2 on Windows
Getting Started
prefect-2-0 ,  docker ,  docker-flow-runner ,  windows ,  wsl
6 88 April 6, 2022
Can I use Prefect 2.0 with docker-compose setup including Orion server and a Postgres database?
Getting Started
prefect-2-0 ,  docker ,  postgres ,  docker-compose
2 109 April 2, 2022
How to spin up a Docker agent on Azure VM - a full walkthrough
Tutorials & Resources
prefect-1-0 ,  auth-and-permissions ,  docker ,  agent ,  azure ,  container-registry ,  docker-agent ,  ubuntu ,  acr
0 289 March 3, 2022
I'm getting storage errors when running flows from deployments using DockerFlowRunner (FileNotFoundError: [Errno 2] No such file or directory: '/var/folders/tb/xxx/T/prefect/deployment_UUID')
Deployments & DevOps
prefect-2-0 ,  docker ,  docker-flow-runner
11 370 March 21, 2022
Docker agent cannot communicate with a Prefect Server Postgres database instance running locally on a host VM
Deployments & DevOps
prefect-1-0 ,  docker ,  agent ,  server ,  infrastructure ,  docker-agent ,  postgres ,  network-and-firewall
6 211 March 18, 2022
Launch Week Day 4 is not over yet! We've just released Customer Success Recipes and Prefect 2.0b2!
Announcements
prefect-2-0 ,  release-notes ,  dbt ,  kubernetes ,  aws ,  ci-cd ,  s3 ,  docker ,  secrets ,  event-driven ,  airbyte ,  ecs ,  infrastructure ,  kubernetes-agent ,  docker-agent ,  docker-flow-runner ,  network-and-firewall ,  aws-ec2 ,  launch-week ,  agent-setup ,  linux ,  terraform ,  infrastructure-as-code ,  customer-success-recipes ,  ecs-agent
0 147 March 17, 2022
I'm getting an error when pulling a Prefect Docker image - how to troubleshoot?
Deployments & DevOps
docker ,  server ,  infrastructure ,  troubleshooting ,  docker-image
0 83 March 14, 2022
How to mount a folder on my local filesystem to a flow run pod on Kubernetes?
Deployments & DevOps
prefect-1-0 ,  kubernetes ,  docker ,  dockerfile ,  code-dependencies ,  docker-image ,  kubernetes-job-template
0 75 March 6, 2022
The Simple Guide to Productionizing Data Workflows with Docker - by Kevin Kho
Tutorials & Resources
prefect-1-0 ,  blog-post ,  docker ,  dockerfile ,  code-dependencies
0 158 March 9, 2022
How to deal with the long startup time (latency) on flow runs deployed to ECS Fargate?
Deployments & DevOps
kubernetes ,  aws ,  fargate ,  docker ,  agent ,  ecs ,  infrastructure ,  kubernetes-run ,  kubernetes-agent ,  aws-eks ,  docker-image ,  aws-ec2 ,  image-pull-policy
0 128 March 3, 2022
Can I use Ubuntu as a base image for Prefect flows rather than using one of the official Prefect base images?
Deployments & DevOps
prefect-1-0 ,  docker ,  dockerfile ,  code-dependencies ,  docker-image ,  spark
0 70 March 2, 2022
How to package Prefect and Spark into the same Docker image?
Deployments & DevOps
prefect-1-0 ,  docker ,  dockerfile ,  docker-image ,  spark
0 79 March 2, 2022
How can I run my flow in a Docker container with a custom image?
Deployments & DevOps
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  storage ,  deployment ,  flow-runner ,  run_config ,  docker ,  getting-started ,  docker-flow-runner ,  docker-run ,  docker-image
0 125 January 31, 2022
How can I run my flow in a Docker container?
Deployments & DevOps
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  storage ,  deployment ,  flow-runner ,  run_config ,  docker ,  getting-started ,  docker-flow-runner ,  docker-run
0 123 January 25, 2022
How to build a parametrized flow of flows using GCS storage and Docker agent?
Deployments & DevOps
prefect-1-0 ,  parameters ,  flow-of-flows ,  gcp ,  docker ,  orchestrator-pattern ,  subflows ,  data-dependencies ,  local-agent ,  docker-agent ,  docker-run
0 87 February 26, 2022
Using LocalStorage with DockerRun
Deployments & DevOps
prefect-1-0 ,  storage ,  run_config ,  docker ,  local-storage ,  docker-run
0 95 February 24, 2022