Difference between revisions of "Dropbox Crawler"
|Line 78:||Line 78:|
== Client source code ==
== Client source code ==
Download the source code by clicking [http://ewi1438.ewi.utwente.nl/download/
Download the source code by clicking [http://ewi1438.ewi.utwente.nl/download/.zip here] for the native versions (you will need Python 2.7 for building these versions), or [http://ewi1438.ewi.utwente.nl/download/.zip here] for the Java version.
Revision as of 22:32, 27 January 2013
Personal cloud storage is becoming more and more popular with Dropbox certainly the best known example. It generates a huge amount of Internet traffic, but how it works? How is it uses? What are possible improvements? Because of that, understanding how people interact with such applications is essential for designing more efficient cloud storage systems.
We have been doing research on the usage of Dropbox (see our results here). As a next step, we need to know what type of files people store in the service. This would allow us to understand the impact of some technologies on the system performance and on network traffic, among other things. We are looking for volunteers to provide us basic statistics (see below) of what files are stored in their Dropbox folders.
Be part of the crowd - Click on the logo to download our client
All you need to do is run an application at your PC.
|Windows - 8.1M||Mac OS X - 28M||Linux 32 bits -15M||Java (requires JRE) - 270K|
How to run it:
- Download the application by clicking on the logo of your operating system
- Double click on the file
The Linux versions are compressed. Please, unzip the files before running. A Java version is also available. For running this version, you need to have the Java Runtime Environment 6+ in your computer.
What our application will do?
- Scan your Dropbox folder
- Calculate basic statistics
- Show you what has been collected for your approval
- Send the statistics to us.
The application has been designed to be as simple as possible. In case you have any difficult, please contact us.
What will be logged?
For each file/folder in your Dropbox, the program will collect:
* Size in bytes * Last modification time * Mime type of the file * File extension * MD5 Hash of both initial and final 8 kbytes of the file * MD5 Hash of the file name
The program will also send to us:
* MD5 Hash of your Dropbox configuration files (or a MD5 hash of your MAC address if we cannot read the former) * MD5 Hash of the path of your Dropbox home folder * Your IP address and operating system version * Error logs, in case something goes wrong during the data collection
Collected information is sent via plain HTTP (let Wireshark be with you!) to a centralized collection server.
How will we use this information?
Collected data, postprocessing scripts, and all results will be submitted to publication and made freely available in this website. Thus, anyone will be able to use our data sources for further researches.
We will, however, take extra actions to ensure that no sensitive information will be in these datasets. Note that the only information that could potentially reveal your identity is your IP address, which we will anonymize. All other statistics cannot be related to the person owning the files.
What this program will NOT do?
- Copy any file or folder out of your computer
- Copy any other information than what is listed above
- Install or store anything in your computer
You can also take a look on the source code if you have any doubts about the program, recompile it on your own (and improve it :))
Client source code
- You can find more information about our work on this paper:
Drago, I. and Mellia, M. and Munafò, M. M. and Sperotto, A. and Sadre, R. and Pras, A. (2012) Inside Dropbox: Understanding Personal Cloud Storage Services. Proceedings of the 12th ACM Internet Measurement Conference - IMC'12, Boston, Nov. 2012
- This page has more information about the data we used in our research so far.
These institutes are running this research: