An warware: kwafin fayil ya haɗe hdfs

Babban matsalar kwafin fayil ɗin haɗe hdfs shine cewa yana iya zama a hankali.

import shutil shutil.copyfile("/hdfs/path/to/file", "/local/path/to/file")

Wannan layin lambar yana shigo da tsarin shutil sannan yana amfani da aikin kwafin fayil ɗin daga wannan tsarin don kwafin fayil daga HDFS zuwa tsarin fayil na gida.

Menene hdfs

HDFS tsarin fayil ne da aka rarraba wanda ke ba da ma'auni, mai dorewa, da abin dogara don manyan bayanan bayanai. An rubuta shi a cikin Java kuma yana gudana akan dandalin Java.

Hanyoyi don haɗa fayiloli

Akwai ƴan hanyoyi don haɗa fayiloli a Python. Hanya mafi sauƙi ita ce amfani da ginanniyar tsarin haɗa fayil ɗin:

shigo da filemerger
file1 = bude ("file1.txt")
file2 = bude ("file2.txt")
merge_file (file1, file2)
buga ("Fayil ya hade!")

Aiki tare da fayiloli

A cikin Python, zaku iya aiki tare da fayiloli ta shigo da tsarin da ya dace. Misali, don shigo da tsarin sarrafa fayil, zaku yi amfani da layi mai zuwa:

daga fayil Mai sarrafa fayil shigo da

Da zarar kun shigo da tsarin, zaku iya samun damar fayiloli ta amfani da sunansu azaman mai canzawa. Misali, idan kuna son samun dama ga fayil ɗin myfile.txt a cikin kundin adireshi na yanzu, zaku yi amfani da layi mai zuwa:

myfile = Fayil ("myfile.txt")

Shafi posts:

Leave a Comment