- code is based on: https://github.com/royvanrijn/iPhoneJTrack
(Thank you royvanrijn!) - It extracts these tables:
- CdmaCellLocation
- CdmaCellLocationHarvest
- CellLocation
- CellLocationHarvest
- WifiLocation
- WifiLocationHarvest
- It converts them to a tab-separated-value file
- compressed with gzip
- Current version 1.3
- Source code of version 1.3
- Currently no license? Suggestions?
Follow us on Twitter
Categories
- Data (3)
- Java applet (1)
- Result (9)
- Visualization (7)
-
Recent Posts
Recent Comments
- 28C3 – Tag 3 – “Don’t fuck Swedish women!” | Offiziere.ch on Fireflies HD
- Michael Kreil on Last database dump
- David Lu on Last database dump
- Michael Kreil on Last database dump
- Rich on Last database dump
Archives
- July 2011 (1)
- June 2011 (1)
- May 2011 (5)
- April 2011 (3)
Pingback: Crowdflow needs you! - Redcode
Question: does this code extract location data for all devices that are backed up on the system or just the first one it finds? In my case, I back up multiple iPhones and iPads to this system…
it chooses the backup with the biggest celllocation-table.
but you can change the backup folder manually. in the next version the app will export the data from all backups.
It chooses the biggest indeed, in my case the one from the iPhone. But when I extract it, then I get a broken .gz file of only 10 byte.
Manually choosing the iPad backup folder gives me a usable .gz for it.
Now, I can simply copy the consolidated.db from the iPhone and send it to you to extract from it. I’d like to not let this data go to waste. What’s your advice?
we received some files of only 10 bytes. obviously a bug … maybe in the gzip-library?
has anybody an idea?
Same here, 10 bytes gzip – no data at all
(running mac os 10.6.7 on new MBP)
For the record, the consolidate.db is about 25.3 MB. But gzip should normally have no problem with that.
ok. i fixed the gzip-bug. the app also exports all backups at once now.
new version: 1.3
now my file is 60bytes
I don’t think it’s fixed yet.
It creates a .gz thats just as big as the iPad-only .gz before with version 1.2
Difference is: The applet stops after that, says “Now you can upload the “crowdflow-data.gz”.” and the progress bar is at about 10-15%, not continuing. The position seems to be about right, as the iPad consolidated.db is ~3MB and the iPhone one is 25 MB.
Should I send you my problematic .db file for testing?
yes, please. thank you!
java log: http://t.co/7tShml1
consolidated.db: http://t.co/X1wlHgT
the table “CdmaCellLocation” was missing! that crashed the export!
i updated version 1.3 … now it’s fixed … hopefully …
thanks Pit!
Still not fixed. Now exporting nothing at all. (35 byte file).
http://pastie.org/1857684
Btw., the iOS on the iPhone is 4.0.1, but shouldn’t matter.
f…! i forgot to uncomment the disabled filelister!
but now it’s
fixed…corrected… changedIndeed, now it zips through all of it. Or so it seems. It generates a reasonably bigger data file now. Though the applet progress bar stalls at 50% when it says it’s done.
Uploaded my data now. Thanks for this project!
the content of the file is:
# version: 1.3
# table: CdmaCellLocation
(but on a GSM iPhone 3GS)
can you start the app in a console?
java -jar crowdflow_1.3.jar
it should then list list all errors …
http://cl.ly/0z2L0y362e2w0j1n2L12
Maybe because my iPhone runs 4.2.1? And this OS don’t know CDMA?
is used so many try-catch-finally brackets it seemed to be impossible that a missing table would abort the export …
thanks!
Thank you..really informative!!
Hi,
I patched the Java app a bit: I made it possible to also fetch the file ‘consolidated.db’ from the user’s desktop. This is useful in case the user has an encrypted iTunes backup, but has a jailbroken device and the possibility to copy the file (/var/root/Library/Caches/locationd/consolidated.db) directly from the device to the desktop.
You can get my version here: https://github.com/pajp/crowdflow
Or see the patch in question: https://github.com/pajp/crowdflow/commit/0563085e224e6bba05787171e856cdb67818a86e
Compiled version: https://github.com/pajp/crowdflow/downloads
I only tested it very lightly, but it seems to work.
Use the Apache 2 license. GPL is restrictive on commercial derivative works and requires the license itself to be reproduced. Permissive software licenses allow greater freedom, which helps get your name out further.
With the file from github
java -jar crowdflow_1.3_src-all.jar
4653 files
899bea80ecb839e5dffd6dbaa8b1ce354591333d
org.tmatesoft.sqljet.core.SqlJetException: CORRUPT: error code is CORRUPT
java.io.FileNotFoundException: /Users/roland/Desktop/Manifest.mbdb (No such file or directory)
With the file from crowdflow.net:
java -jar crowdflow_1.3.jar
4653 files
899bea80ecb839e5dffd6dbaa8b1ce354591333d
org.tmatesoft.sqljet.core.SqlJetException: CORRUPT: error code is CORRUPT
What should I do ?
How can I help ?
Good question! Does anybody have any idea?
Is your backup encrypted? What iOS version do you use?
Backup is not encrypted.
iOS version 4.3.1
iPhoneTracking app work fine and download all points.
I also was able to apply patch to import cells and wifi with full accuracy.
Is there a way to provide you the data in an other format using a patch to iPhoneTracking ?
That way you could get points from Belgium and I could apply iOS 4.3.3 update to my iPhone.
I made a copy of the backup just in case.
Is the project dead since the recent “fix” by Apple ?
Hi all,
I would like to contribute my consolidated.db. Of course I already installed the iOS-Update, so I can no longer extract it from the default backup location.
Instead I would like to extract consolidated.db’s from my TimeMachine backups. I also think that this would be an easy way to still get db’s even from people who already updated.
I could imagine some kind of “Choose backup location”-button or something similar. It would be great if someone could add this to the applet.
I actually found the right line in the source, change it to a static TM location, but then failed to compile due to lack of experience with java
Thanks in advance
ljr
Rasmus Sten built an alternate version.
Where is the ‘consolidated.db’ file normally located? I could use the info for PC and Mac. on my PC I changed my iTunes Media folder to a networked drive.