topic Re: How to get the path of files using python os library in Data Engineering

How to get the path of files using python os library

sp3234 — Fri, 31 Aug 2018 13:29:48 GMT

unable to find the path to directory with os library

Re: How to get the path of files using python os library

User16752239222 — Fri, 31 Aug 2018 17:42:22 GMT

Hi @sp3234

When using the local file APIs to read and write to dbfs paths, you should reference using "/dbfs/..." rather than "dbfs/..."

Here's an example that compares the result of local file APIs to using the %fs magic keyword in a notebook cell.

reference documentation

Re: How to get the path of files using python os library

Wistech_biz — Wed, 06 Feb 2019 10:53:52 GMT

Being a web developer I've used this:

>>> import os >>> os.path.abspath("C:/example/cwd/mydir/myfile.txt") 'C:/example/cwd/mydir/myfile.txt'

Re: How to get the path of files using python os library

rickwilliam — Sun, 06 Sep 2020 06:58:21 GMT

I am working with Magento 2 extensions development company and i am a python developer since 5 years here is my answer.

 Python program to explain os.getcwd() method

# importing os module

import

os

# Get the current working

# directory (CWD)

cwd

os.getcwd()

# Print the current working

# directory (CWD)

print

"Current working directory:"

print

(cwd)

Re: How to get the path of files using python os library

tomjenner — Mon, 07 Sep 2020 07:50:15 GMT

In my opinion, it's hard to get the path of files using python os library. As a programmer who is engaged in software development for small business, I'm interested in the answer too.

Re: How to get the path of files using python os library

KrishZ — Thu, 15 Dec 2022 22:28:22 GMT

Hi,

os.getcwd() simply prints '/databricks/driver' for me irrespective of the location of the file..

Ideally I would like to get "/dbfs/FileStore/shared_uploads/krishna@company.com/Project_Folder"

Thanks

Re: How to get the path of files using python os library

KrishZ — Thu, 15 Dec 2022 22:28:50 GMT

Hi mate, did you get the answer?

os.getcwd() simply prints '/databricks/driver' for me irrespective of the location of the file..

Ideally I would like to get "/dbfs/FileStore/shared_uploads/krishna@company.com/Project_Folder"

Thanks

Re: How to get the path of files using python os library

Aviral-Bhardwaj — Fri, 16 Dec 2022 15:50:26 GMT

@sp3234

Please use this it will work