Paweł Biernat
05/30/2024, 1:25 PMget/put_directory
methods for filesystem, but no get/put_file
methods? fsspec
seems to support these. If I have a pipeline that requires a single file as an input do I have to download the entire folder?Matthew Bell
05/30/2024, 2:41 PMMatthew Bell
05/30/2024, 2:42 PMPaweł Biernat
05/30/2024, 5:46 PMPaweł Biernat
05/30/2024, 5:49 PMPaweł Biernat
05/30/2024, 6:13 PMfs = SMB.load("azure-file-share")
while I'd like something like
fs = RemoteFileShare.load("azure-file-share")
pass "azure-file-share"
as a parameter to the flow to future proof the pipeline against swapping storage backend type. Does something like this make sense?