Is it possible to create a torrent without hashes?

Any other tech-related topics
Post Reply
Message
Author
Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Is it possible to create a torrent without hashes?

#1 Post by Marc »

I've like from forever be able to share a list of large files/documents or why not sometimes the entire external hard drive.
There is Wedrima and Snap2Html but I attempted with both to create a list of a large list of files. The first was able to handle more but not an antire external drive. So they may be most suitable for smaller list of files/not hughe. And the problem for large files may not be of the applications perse, but of html.
Why not using a format that is known for creating/storing metadata for a large number of files?

So the question is if is possible to create torrents without hashes, in order to speed up the process. Perhaps it would be possible for an application to search whitin a torrent files/metadata of files, but for that additionally it can be used the latest beta of Everything that supports creating file listing of all indexed
files/directories which can then be imported back or configure Everything to only load them on start for searching not connected drives or an specific directory/file list.

User avatar
Napiophelios
Posts: 610
Joined: Sun Mar 01, 2009 5:48 pm

Re: Is it possible to create a torrent without hashes?

#2 Post by Napiophelios »

I think hashes are essential for safety in any community that shares files amongst themselves.

I think instead of some list maker with metadata you need a specialized torrent program that will do all that cataloging for you.

I remember eMule would allow you to add/subtract folders to a share list on the fly;
it would analyze the files itself and generate the hashes and log them.
of course I dont know of any torrent programs that do this.

Specular
Posts: 443
Joined: Sun Feb 16, 2014 10:54 pm

Re: Is it possible to create a torrent without hashes?

#3 Post by Specular »

Napiophelios wrote:I think hashes are essential for safety in any community that shares files amongst themselves.
This. No idea about the hashing process in torrent clients per se, but being able to compare hashes of files is essential for security purposes.

Without them anyone could modify an original file for download and the user would have no idea that an unauthorized change has been made. Of course in reality most users aren't even aware of the benefit, so it's likely not a big deal, but for file sharing in general it's a must.

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#4 Post by Marc »

Hum maybe a bit off-topic but how are hashes handles with magnet links?
After adding a magnet link a torrent files is created in uTorrent's AppData
http://www.ghacks.net/2012/01/14/how-to ... rent-file/
And as far as I can tell when I click on force re-check it only checks that the files are present.

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Is it possible to create a torrent without hashes?

#5 Post by webfork »

> Why not using a format that is known for creating/storing metadata for a large number of files?

VVV will store some metadata, or you can dig through the full list of file catalogers.

The only thing I could find for metadata beyond that was a Powershell tweak. If memory serves there are some fans of that program here on the forums so you might be able to get some help if you run into trouble there.

If I were you, I might contact the maker of Directory Lister and ask if his Pro program will do that: http://www.krksoft.com/index.php . I don't think torrent files are able to store metadata so generating one without hashes wouldn't be beneficial. Unfortunately I also don't know of a file listing program that stores metadata.

> how are hashes handles with magnet links?

Magnet links just point to distributed torrent files to get away from the idea that a torrent site is is hosting anything. It still downloads a torrent before anything else happens.

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#6 Post by Marc »

webfork wrote:VVV will store some metadata, or you can dig through the full list of file catalogers.
VVV crashed, can't handle large volumes. On the other hand a torrent file is incredible samller and can be opened in a hieralchical tree. Wedrima, Snap2Html and VVV all create a very large file for a large number of files
webfork wrote:The only thing I could find for metadata beyond that was a Powershell tweak. If memory serves there are some fans of that program here on the forums so you might be able to get some help if you run into trouble there.
Does it support presenting the files/directories in a tree view?
webfork wrote:If I were you, I might contact the maker of Directory Lister and ask if his Pro program will do that: http://www.krksoft.com/index.php . I don't think torrent files are able to store metadata so generating one without hashes wouldn't be beneficial. Unfortunately I also don't know of a file listing program that stores metadata.

But pretty much I'm interested in filename and size (which as far as I can tell are metadata ;)I'm kind of extremly tired, is it a good idea to post a thread of all the applications I'm searching for right now?
Off-topic has http://www.donationcoder.com/Software/M ... essPiglet/ been posted?

PD: Mozilla crashed right while I was finishing the post... thanks sessionstore.js! -:)

User avatar
SYSTEM
Posts: 2041
Joined: Sat Jul 31, 2010 1:19 am
Location: Helsinki, Finland

Re: Is it possible to create a torrent without hashes?

#7 Post by SYSTEM »

Marc wrote:
webfork wrote:The only thing I could find for metadata beyond that was a Powershell tweak. If memory serves there are some fans of that program here on the forums so you might be able to get some help if you run into trouble there.
Does it support presenting the files/directories in a tree view?
Powershell is not a program, it's a scripting language. Anything can be done with it, but it requires that someone writes a script first. ;) (In addition, if programs struggle with so many files, scripts may be too slow for your task.)
Marc wrote: Off-topic has http://www.donationcoder.com/Software/M ... essPiglet/ been posted?
No, it hasn't.
My YouTube channel | Release date of my 13th playlist: August 24, 2020

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#8 Post by Marc »

Forgot to add in the earlier post (I was writting in one notepad then I switched and totally forgot about it.
Maybe is a good idea try contacting http://mktorrent.sourceforge.net/ or http://mathr.co.uk/blog/torrent.html they may be able to tell whether is possible to create a torrent without hashes or not,
if not I'd hope powershell can create a tree file list for a large number of files and with small size.
Or that in the future Everything add a tree view mode.
If you and webfork think powershell is up for the task then I take you and webfork's word.
While considering all option I could ask in a torrent client forum, but they should have no interest in creating a hashless torrent.

User avatar
webfork
Posts: 10818
Joined: Wed Apr 11, 2007 8:06 pm
Location: US, Texas
Contact:

Re: Is it possible to create a torrent without hashes?

#9 Post by webfork »

Marc wrote:filename and size (which as far as I can tell are metadata
Nope. Metadata is something else https://en.wikipedia.org/wiki/Metadata
Marc wrote:I take you and webfork's word
To clarify: I just pointed to that based on some initial research. Not meant to be a recommendation. So for example, I recommend LibreOffice and CubicExplorer. PowerShell just looks interesting and a potential solution to your concerns.

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#10 Post by Marc »

webfork wrote:Nope. Metadata is something else https://en.wikipedia.org/wiki/Metadata
though it meets the broad definition of "data about data". Interesting.
webfork wrote: To clarify: I just pointed to that based on some initial research. Not meant to be a recommendation. So for example, I recommend LibreOffice and CubicExplorer. PowerShell just looks interesting and a potential solution to your concerns.
:D Edit: just to be sure I meant that is good to know you are so... (and I'm missing the word) :S

I didn't want to post this but, current alternative right now is use ZeroZipper and then create a torrent using as source the extracted ZeroZipper output, wich is basically a "mirror". The disadvantage is that there are no file sizes.

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#11 Post by Marc »

Lately I've been using more and more qBitorrent... and discovered it can create torrents with no hashes and with zero bytes files. Not only that it allows to view torrents added to the client in a tree-like view unlike utorrent which is a plain view. Files for a loaded torrent can be searched via "Filter files" which works fine for files.

Marc
Posts: 165
Joined: Sun May 15, 2011 6:06 pm

Re: Is it possible to create a torrent without hashes?

#12 Post by Marc »

To be more clear in order this are the steps to follow to create a catalog.
1. Create a folder/files structure as zero-byte files using ZeroZipper http://www.portablefreeware.com/?id=1573
2. Modify in any way you want the 0-bytes mirror of your folder/files like deleting private files or mixing more than one ZeroZipper mirrors.
3. Create a torrent out of the folder containing the 0 bytes files and mirrored folder structure, using qBittorrent via Tools > Torrent Creator.
4. Upload/Share the Catalog stored in the tiny torrent file. Do note this created torrent can only be previewed and loaded in qBittorrent.

Post Reply