ray can set resources for each operator, how can i set resources on @task ?
like this:
@task(cluster_kwargs={“n_workers”: 1, “resources”: {“GPU”: 1, “process”: 1}})
def spliter(file):
do spliter
@task(cluster_kwargs={“n_workers”: 5, “resources”: {“GPU”: 1, “process”: 1}})
def process(str):
do process;