Description: KleanSweep allows you to reclaim disk space by finding unneeded files. It can search for files basing on several criterias; you can seek for: * empty files * empty directories * backup files * broken symbolic links * broken executables * dead menu entries (.desktop files pointing to non-existing executables) * obsolete thumbnails (thumbnails of non-existing images) * duplicated files * orphaned files (files not found in RPM or DEB database).
Results for each criteria are shown in separate tab; files may appear on many tabs if they match many criterias - in this case they are "linked", so you have to mark (or unmark) file for deletion only once! Before actual deletion takes place, you're given an option to create backup archive.
Planned features: * seeking for orphaned files in Slackware and Gentoo (portage) database * and more!
KleanSweep consists of KDE-based (C++) graphical frontend and small helper Perl script that performs actual searching. All searches, except for orphaned files, duplicates and dead menu entries are as fast as usual 'find' would be.
This is initial release and may contain bugs. I take no responsibility for any damage caused by this program.
Note: it may compile/work in KDE < 3.4.x, but was only tested in 3.4.2.Last changelog:
kleansweep spends a ton of CPU time updating the GUI while loading the dup list. While actually deleting the dups, it keeps Xorg at > 80% CPU usage (on my C2Duo desktop, g965 graphics, Ubuntu Jaunty). It looks like it redraws the whole window every for every file it deletes! Not good! It keeps Xorg busy even when the window is minimized. (I'm running fluxbox; I don't know if kwin can tell kde apps that they don't need to actually draw when they're minimized...) The not-drawing-when-minimized optimization should probably be in Qt or KDE, not in individual apps, though.
BTW, I'm using it to compare sets of files recovered with different methods from a half-lost filesystem. I've mostly had to hack stuff together in Perl, because I haven't found anything that lets you essentially subtract files found in other directories from files in one given directory. i.e. for a given directory, keep only stuff that isn't a duplicate of something outside that directory. I want to subtract sets of files.
I've done some stuff with perl parsing the output saved by fslint-gui, but it's a pain.
hmm, I just found komparator. It might do what I want...
forgot to mention: the total duplicated size looks like it suffers from signed 32bit overflow. Use long long, int64_t, or off_t with
#define _FILE_OFFSET_BITS 64
Hi,
does kleansweep delete cache files ?
If not, can you add a checkbox and the script to delete all browser cache files, cookies, ... (for all present cache : opera, konqueror, ...).
If you do something for slackware can you please also do it for SLAX (this SLAX distro is based on a SLACKWARE and is really easy to install on USB to test). www.slax.org
Thanks for your work and have a nice day,
Miguipda ;-)
I tried to use 'tar -xzf backup.tar.gz' to restore my backup files and got...
tar: backup.tar.gz: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error exit delayed from previous errors
What now?
Hey
I'm only an ordinary Linux user, who don't know must about systemfiles etc. So I made some mistake and is now unable to start Ubuntu properly. I only reach the Linux systempromt.
Before execute the cleanproces - I made a backup of the deleted files and I'm able to list the backup file. But I'm to inexperienced to do anything with it.
Hence some sort of automatic recovery opportunity would by really nice -
Ps: do somebody know which code I should type to unpack the backup file, and place the files in their original directories?
I would be very great full if you can help.
The backup file is a plain .tar.gz archive. You can unpack it with 'tar -xzf backup.tar.gz'.
Thanks for suggestion about 'restore' functionality in KleanSweep. I'm going to make it easier, probably by creating self-extracting archives (if requested by user).
I tried to use 'tar -xzf backup.tar.gz' to restore my backup files and got...
tar: backup.tar.gz: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error exit delayed from previous errors
I don't like self-extracting archives. I prefer having extraction handled by archive software I trust, and whose behaviour I understand. e.g. by using
tar xkf ...
I know I won't replace existing files.
If you want to make it easier to beginners, make an undo-cleanup option in the GUI. You could just prompt the user for the file to restore from, if you don't want to get all fancy with keeping track of which file was created by which cleanup action to provide more kleanup-specific metadata for the restore files.
I LOVE this tool, especially the duplicate file finder, but I noticed one way it could be improved:
When it finds duplicate files, it shows them all. Let's say there are 4 files that are duplicates. Hitting "Select all" and next would remove them ALL, not just the 3 duplicates. I think there should be a button that would select everything in the list under each "parent" file detected. This would allow users to easily hit it and continue, removing the 3 duplicates but leaving ONE of them in place. This would remove the duplicates, but not result in any data loss!
I'm trying to install KleanSweep on a debian testing system. Although I give the the kdeincludes path (/usr/include/kde) scons doesn't find it.
$ scons qtdir=/usr/lib/qt3 kdeinclude=/usr/include/kde
scons: Reading SConscript files ...
Checking for kde-config : kde-config was found as /usr/bin/kde-config
Checking for kde version : 3.5.7
Checking for the qt library : qt is in /usr/lib/qt3
Checking for uic : uic was found as /usr/bin/uic
Checking for moc : moc was found as /usr/bin/moc
Checking for the qt includes : the qt headers were found in /usr/include/qt3/
Checking for the kde includes : The kde includes were NOT found
Hi,
I verify if all is wel installed with my adept (under kubuntu) package installtion tool.
Scons, Python, Perl and all the needed program are well installed.
But when I do the first command : scons, I receive this error message :
scons: Reading SConscript files ...
Checking for kde-config : kde-config was found as /usr/bin/kde-config
Checking for kde version : 3.5.5
Checking for the qt library : qt was not found
Please set QTDIR first (/usr/lib/qt3?) or try scons -h for more options
I verify and saw that qt3 is well installed. So what happend under my kubuntu 6.10
What must I do ?
Have a nice days,
Miguipda ;-)
Hy.
Kleansweep is quite nice already, but the Remove duplicate file has a BIG issue :
When clicking "select all", it realy select every file, so you erase the original and the copy ! Thanks to the warning message, I avoid this catastrophe, but when you have 1,234 duplicates, you will spend a few hours selecting every file in the list.
I beleive the tool should search for every directory containing this files, then, group duplicated files in duplicated directories showing the compleate path, and the, you can choose to delete a directory ( in my case, it's albums of music and fotos which are duplicated, so il whill divide the number of clics by 5~10 ).
It may also be possible to erase the file whitch is the uper or downer in the file system ( for instance, delete /home/x/photo/double.png and not /home/x/photo/november2006/1st/double.png)
If a GTK solution is amenable, have a look at:
http://www.pixelbeat.org/fslint/
It allows you to select all but the "first", "oldest", "newest" in each group.
Hi, thanks for suggestion. The current behavior of "Select All" on Duplicated files page is definately a problem. I'm going to improve this page in the next release so that removing all files by accident will be impossible/harder. Unfortunately the idea with grouping duplicated files in duplicated directories is hard to implement and therefore I'm not going to do that any time soon. However, I'm going to change this page a bit, so that files are grouped in "virtual" directories with names indicating their number, size and possibly content, e.g.
+[5 mp3 files, 15kB each]
+[2 text files, 1kB each]
False positives are not possible, because KleanSweep compares file contents (not just sizes or names -- in fact, name is not taken into account at all). The only possible way to fool KleanSweep is to change file contents after scanning is finished (files are not compared again on removal).
If you observered anything else, then either: file content has changed after scanning was finished or you found a bug (in that case please provide more information).
I couldn't believe what happened after cleaning my system (~15.000 dead symlinks/zero byte files/...).
It was as fast as it has never been before.
It's a Gentoo running since more than 4 years without any re-installation and I always thought dead files couldn't have any impact on my system performance, but now, im enlightened ;-)
Thank you for this great tool... I hope it get's Portage support integrated soon.
Ratings & Comments
128 Comments
Please update for kde4
I use Duplicate Finder From Ashisoft to remove file duplicate from the drive. http://www.ashisoft.com
Is there any chance of porting this app to KDE 4 ?
any chance this gets updated for kde 4? :)
yes please port to kde4 platform
kleansweep spends a ton of CPU time updating the GUI while loading the dup list. While actually deleting the dups, it keeps Xorg at > 80% CPU usage (on my C2Duo desktop, g965 graphics, Ubuntu Jaunty). It looks like it redraws the whole window every for every file it deletes! Not good! It keeps Xorg busy even when the window is minimized. (I'm running fluxbox; I don't know if kwin can tell kde apps that they don't need to actually draw when they're minimized...) The not-drawing-when-minimized optimization should probably be in Qt or KDE, not in individual apps, though. BTW, I'm using it to compare sets of files recovered with different methods from a half-lost filesystem. I've mostly had to hack stuff together in Perl, because I haven't found anything that lets you essentially subtract files found in other directories from files in one given directory. i.e. for a given directory, keep only stuff that isn't a duplicate of something outside that directory. I want to subtract sets of files. I've done some stuff with perl parsing the output saved by fslint-gui, but it's a pain. hmm, I just found komparator. It might do what I want...
forgot to mention: the total duplicated size looks like it suffers from signed 32bit overflow. Use long long, int64_t, or off_t with #define _FILE_OFFSET_BITS 64
Hi, does kleansweep delete cache files ? If not, can you add a checkbox and the script to delete all browser cache files, cookies, ... (for all present cache : opera, konqueror, ...). If you do something for slackware can you please also do it for SLAX (this SLAX distro is based on a SLACKWARE and is really easy to install on USB to test). www.slax.org Thanks for your work and have a nice day, Miguipda ;-)
I tried to use 'tar -xzf backup.tar.gz' to restore my backup files and got... tar: backup.tar.gz: Cannot open: No such file or directory tar: Error is not recoverable: exiting now tar: Child returned status 2 tar: Error exit delayed from previous errors What now?
Hey I'm only an ordinary Linux user, who don't know must about systemfiles etc. So I made some mistake and is now unable to start Ubuntu properly. I only reach the Linux systempromt. Before execute the cleanproces - I made a backup of the deleted files and I'm able to list the backup file. But I'm to inexperienced to do anything with it. Hence some sort of automatic recovery opportunity would by really nice - Ps: do somebody know which code I should type to unpack the backup file, and place the files in their original directories? I would be very great full if you can help.
The backup file is a plain .tar.gz archive. You can unpack it with 'tar -xzf backup.tar.gz'. Thanks for suggestion about 'restore' functionality in KleanSweep. I'm going to make it easier, probably by creating self-extracting archives (if requested by user).
I tried to use 'tar -xzf backup.tar.gz' to restore my backup files and got... tar: backup.tar.gz: Cannot open: No such file or directory tar: Error is not recoverable: exiting now tar: Child returned status 2 tar: Error exit delayed from previous errors
I don't like self-extracting archives. I prefer having extraction handled by archive software I trust, and whose behaviour I understand. e.g. by using tar xkf ... I know I won't replace existing files. If you want to make it easier to beginners, make an undo-cleanup option in the GUI. You could just prompt the user for the file to restore from, if you don't want to get all fancy with keeping track of which file was created by which cleanup action to provide more kleanup-specific metadata for the restore files.
I LOVE this tool, especially the duplicate file finder, but I noticed one way it could be improved: When it finds duplicate files, it shows them all. Let's say there are 4 files that are duplicates. Hitting "Select all" and next would remove them ALL, not just the 3 duplicates. I think there should be a button that would select everything in the list under each "parent" file detected. This would allow users to easily hit it and continue, removing the 3 duplicates but leaving ONE of them in place. This would remove the duplicates, but not result in any data loss!
I should have included this before, but this is a visual representation of what I am thinking. http://www.hotlinkfiles.com/files/1176966_8w6is/VisualExample.tar.bz2]VisualExample.tar.bz2 (170 Kb, tar.bz compressed archive) contents: 4 images, "png" filetype
Hi, thanks for your suggestion. This is definately a problem and I'm going to do something about it in the next release.
I'm trying to install KleanSweep on a debian testing system. Although I give the the kdeincludes path (/usr/include/kde) scons doesn't find it. $ scons qtdir=/usr/lib/qt3 kdeinclude=/usr/include/kde scons: Reading SConscript files ... Checking for kde-config : kde-config was found as /usr/bin/kde-config Checking for kde version : 3.5.7 Checking for the qt library : qt is in /usr/lib/qt3 Checking for uic : uic was found as /usr/bin/uic Checking for moc : moc was found as /usr/bin/moc Checking for the qt includes : the qt headers were found in /usr/include/qt3/ Checking for the kde includes : The kde includes were NOT found
I installed kde-devel and maby kde-devel-extra, after this its works for me. RnR
Hi, I verify if all is wel installed with my adept (under kubuntu) package installtion tool. Scons, Python, Perl and all the needed program are well installed. But when I do the first command : scons, I receive this error message : scons: Reading SConscript files ... Checking for kde-config : kde-config was found as /usr/bin/kde-config Checking for kde version : 3.5.5 Checking for the qt library : qt was not found Please set QTDIR first (/usr/lib/qt3?) or try scons -h for more options I verify and saw that qt3 is well installed. So what happend under my kubuntu 6.10 What must I do ? Have a nice days, Miguipda ;-)
Hy. Kleansweep is quite nice already, but the Remove duplicate file has a BIG issue : When clicking "select all", it realy select every file, so you erase the original and the copy ! Thanks to the warning message, I avoid this catastrophe, but when you have 1,234 duplicates, you will spend a few hours selecting every file in the list. I beleive the tool should search for every directory containing this files, then, group duplicated files in duplicated directories showing the compleate path, and the, you can choose to delete a directory ( in my case, it's albums of music and fotos which are duplicated, so il whill divide the number of clics by 5~10 ). It may also be possible to erase the file whitch is the uper or downer in the file system ( for instance, delete /home/x/photo/double.png and not /home/x/photo/november2006/1st/double.png)
If a GTK solution is amenable, have a look at: http://www.pixelbeat.org/fslint/ It allows you to select all but the "first", "oldest", "newest" in each group.
Hi, thanks for suggestion. The current behavior of "Select All" on Duplicated files page is definately a problem. I'm going to improve this page in the next release so that removing all files by accident will be impossible/harder. Unfortunately the idea with grouping duplicated files in duplicated directories is hard to implement and therefore I'm not going to do that any time soon. However, I'm going to change this page a bit, so that files are grouped in "virtual" directories with names indicating their number, size and possibly content, e.g. +[5 mp3 files, 15kB each] +[2 text files, 1kB each]
To reduce false positives under the Duplicate file tab, wouldn't it be better to compare MD5sums before listing it?
False positives are not possible, because KleanSweep compares file contents (not just sizes or names -- in fact, name is not taken into account at all). The only possible way to fool KleanSweep is to change file contents after scanning is finished (files are not compared again on removal). If you observered anything else, then either: file content has changed after scanning was finished or you found a bug (in that case please provide more information).
I couldn't believe what happened after cleaning my system (~15.000 dead symlinks/zero byte files/...). It was as fast as it has never been before. It's a Gentoo running since more than 4 years without any re-installation and I always thought dead files couldn't have any impact on my system performance, but now, im enlightened ;-) Thank you for this great tool... I hope it get's Portage support integrated soon.