Projects / yahoo2mbox / Comments

Comments for yahoo2mbox

07 Jan 2008 13:48 Locoblade

Batch file to automate yahoo2mbox
Hi All

Having struggled getting my Yahoogroup downloaded in a decent amount of time using yahoo2mbox due to the amount of times my account got locked out by Yahoo, I just thought I'd share the following batch file with you that I wrote that resolved it for me, allowed me to download 60,000 messages in about 4 days without getting locked out.

The script uses 2 usernames/passwords to share the load, so if you only have one username you'll need to register another, although I just used another named profile within the same Yahoo user account as even if one gets locked out, the other seems to continue working.

Copy the entire script below into notepad and save it as runme.bat in a new folder. In the same folder you'll also need the yahoo2mail.pl file and also a file called sleep.exe which you can officially get in the Windows 2003 Resource kit, but there's a version here that will also do the job: http://www.computerhope.com/dutil.htm

Script as follows, copy between the ======

=====================================

@echo off

set /p groupname=Set Yahoo Group Name ...

set /p startat=Set message download start number (usually 0)...

set /p add=Set Number of messages to download each time (Recommend 75)...

set /p delay=Set delay time in seconds (Recommend 2)...

set /p username1=Set Username 1 ...

set /p password1=Set Password 1 ...

set /p username1=Set Username 2 ...

set /p password2=Set Password 2 ...

cls

:initial run

set /a endat=%startat%+%add%

yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat% "%groupname%"

sleep 90

:continue

set /a endat2=%endat%+%add%

echo %endat2%

yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"

set error=%errorlevel%

echo %error%

if not %error%==0 goto retry

set endat=endat2

sleep 90

goto continue

:continue2

set /a endat2=%endat%+%add%

echo %endat2%

yahoo2mbox.pl -user="%username2%" -pass="%password2%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"

set error=%errorlevel%

if not %error%==0 goto retry2

set endat=endat2

sleep 90

goto continue2

:retry

echo %error% >log.txt

yahoo2mbox.pl -user="%username2%" -pass="%password2%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"

set error=%errorlevel%

set endat=endat2

if %error%==0 goto continue2

sleep 900

goto retry2

:retry2

echo %error% >log.txt

yahoo2mbox.pl -user="%username1%" -pass="%password1%" -verbose --resume -delay=%delay% -end=%endat2% "%groupname%"

set error=%errorlevel%

set endat=endat2

if %error%==0 goto continue

sleep 900

goto retry2

pause

=====================================

Once you have the batch file, the sleep.exe and the yahoo2mbox.pl file in the same location, run the batch file and it will prompt you for the required information and recommend the delay / download settings I used that seemed to work without overloading the download limits. If it does overload and lock out, it will switch to the second account, which should give time for the first one to unlock again. Once the second one locks out, it switches back to the first one again and so on.

Hope it helps someone.

22 Nov 2004 10:28 websissy

Re: What about files


> Hi Is there any way to download files

> stored on a yahoo group?

>

>

If you found this tool of interest, then you might find this one helpful as well.

http://freshmeat.net/projects/grabyahoogroup/

It includes downloads for photos, files, member list, attachments and messages...

Good Luck!

WebSissy

06 Aug 2004 01:29 afterburnerltt

What about files
Hi Is there any way to download files stored on a yahoo group?

26 Aug 2003 17:52 Adjie

Re: failed with yahoo2mbox

> yahoo2mbox failed to retrieve message
> from
> yahoogroups and give:
> <x-html> tag not found
>
> any idea how to solve this?

i hope this problem will solved soon

26 Aug 2003 00:40 paulusta

Re: failed with yahoo2mbox

> AFAICS yahoo has changed the ouput of
> view source
> messages.
>
> try searching for <!-- start content
> include
> -->
> instead of <x-html>. Then you have
> to deal
> with
> the multiple <tt> tags, that are
> used to
> contain
> different parts of the message. eg the
> header is
> one tt, the body is another & if the
> message is
> multipart/mime there will be heaps of
> <tt>stuff
> here</tt><br> & it all needs
> to be
> converted.
>
> please im/email me if you want a sample
>


Have somebody been able to solve this "x-html tag not found" error message?
I use yahoo2mbox 0.14 and the problem still occured.

22 Aug 2003 00:12 pabs3

Re: failed with yahoo2mbox

>
> %
> % % yahoo2mbox failed to retrieve
> message
> % % from
> % % yahoogroups and give:
> % % <x-html> tag not found
> % %
> % % any idea how to solve this?
> %
> %
> % I've received the reports about it but
> I
> % don't really know why does it happen
>


AFAICS yahoo has changed the ouput of view source
messages.

try searching for <!-- start content include
-->
instead of <x-html>. Then you have to deal
with
the multiple <tt> tags, that are used to
contain
different parts of the message. eg the header is
one tt, the body is another & if the message is
multipart/mime there will be heaps of
<tt>stuff
here</tt><br> & it all needs to be
converted.

please im/email me if you want a sample

14 May 2003 01:20 cmbtr

problem with yahoo2mbox
yahoo2mbox version 014 does not retrieve messages
from some yahoogroups where messages archives is closed
and needs a userid and password to login.

there is a long delay after login but no messages are retrieved.

29 Mar 2003 12:16 vadz

Re: Age-Restricted Area of Yahoo! Groups.

> % My question, How can we download from
> % this "Age-Restricted Area".

I've forgot to mention here that it is possible to do it starting from version 0.12 -- or at least should be, I couldn't test it myself.

29 Mar 2003 12:13 vadz

Re: failed with yahoo2mbox

> This occurs because you have reach your
> download limit


Indeed, thanks for looking into this.

The trouble is that I still don't know what to do about this. Well, I've at least added a (hopefully) more clear error message and a note about this in the script description.

26 Mar 2003 03:40 rgladwell

Re: failed with yahoo2mbox
This occurs because you have reach your download limit: if you look at the page in question it has the following error:

"The message you requested is temporarily unavailable because this group has exceeded its download limit. Please try again later."

Since yahoo2mbox.pl appends to an already downloaded list you can simply try the same command again later. :)

Screenshot

Project Spotlight

ReciJournal

An open, cross-platform journaling program.

Screenshot

Project Spotlight

Veusz

A scientific plotting package.