Skip to content

databricks fs does not work with Volumes, despite documentation #1157

@NodeJSmith

Description

@NodeJSmith

Describe the issue

I cannot determine how to use the fs command with Databricks volumes and/or if this is supported. On this Databricks docs page it states that you must use the dbfs:/ prefix when using the Databricks CLI and it lists an example:

image

image

And this code implies handling of /Volumes/. Yet when I use databricks fs ls dbfs:/Volumes/ or databricks fs cp -r dbfs:/Volumes/dev/default/test/ . I get the following error

image

Steps to reproduce the behavior

  1. Run databricks fs ls dbfs:/Volumes/

Expected Behavior

I expect that this would work and list the volumes contents.

Actual Behavior

The error message Error: filer.ReadDir is not implemented for the Files API is returned

OS and CLI version

CLI Version - Databricks CLI v0.212.2
OS Version - Ubuntu-22.04 via WSL2 on Windows 11

Is this a regression?

I've never managed to get this to work, but I cannot speak to the previous versions of the Databricks CLI I used.

Debug Logs

10:50:27  INFO start pid=401774 version=0.212.2 args="databricks, fs, ls, dbfs:/Volumes/, --debug"
Error: filer.ReadDir is not implemented for the Files API
10:50:27 ERROR failed execution pid=401774 exit_code=1 error="filer.ReadDir is not implemented for the Files API"

Metadata

Metadata

Labels

CLICLI related issues

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions