Bugs and quirks in 1.0.5 (svn)

[thorwak]

Let me know if you want complete logs (they get kinda of huge though, plenty of read line: and stuff

Edit: I guess maybe it shouldn't get articles 0 - 0 but rather skip the whole "getting" part if it's 0 - 0? I haven't looked at the code though.

I made some adjustments here... pls see if the are helping

Yep seems fine now, cool.

[spearhead]

weird ... I just disabled all servers and it still starts up fine... (doesn't do much useful stuff tho...). Even without any servers at all it simple starts up fine.

[thorwak]

Ok I can try to re-create this at some point, it was straight after a fresh istallation which may matter (no group list existing for instance). I'll get back on this if I see it again.

[spearhead]

Just tried this... you may have run into this error instead:

Code:

CRITICAL An error occured during startup of URD daemon: File not found (urdd) /var/www/urd/urdd.sh. Check admin/config

And that fails to start URDD

[thorwak]

I ran into that too, but that was just me being stupid Also, it doesn't leave any running process that has to be killed..

EDIT: Or maybe it does.. Hmm you might be right.. I'd say I had it happen even after I fixed the path, but now I got unsure..

[thorwak]

I tested this again now. I can't reproduce it anymore (and I noted latest svn code automatically saves the correct path to urdd - nice).

I probably mixed it up with it starting the wrong urdd.sh like you suggested, so forget about this one.

[Reab4]

Ah you paid the bills again

svn 1447, noticed so far:

1 - in log page, log file level set per default doesn't follow the admin>config setting
2 - can not import server settings; import button yields no response
3 - importing all settings from the admin>control page yields 'No valid action found.'
4 - I downloaded a file from ViewFiles>Downloads. It prepends the filename with an '_'
5 - after the 4 download I lost connection with the server
6 - recovered after a while

[spearhead]

I don't know what happened to the website  really 

Anyway
1) I never intended to set it. Can change tho
2) I'll look into that.... sounds like a javascript problem
3) that too
4)that's weird.... I'll look into that too...
5) weird maybe something choked somewhere....
6) that's better...

[Reab4]

3 - Admin>control>EportAllSettings sounds like an export of all URD settings, including server list, group list and user settings.
If it's true, then it saves under the same (default) name as Admin>Configuration:
urd_config.xml. Perhaps change the default name to reflect the AllSettings.

[spearhead]

Correct it saves all settings... I'll look into the name

[spearhead]

2. 3 and 4 should be fixed now.

[spearhead]

1 is done too..

[Reab4]

All confirmed. Thanks!

[Reab4]

If I download a file from the ViewFiles>Downloads section, a firefox download window opens and starts the download. During the download, firefox is not able to (auto)refresh other tabs as activity in the urd tab is preventing this. Pressing ESC in the urd tab releases the lock. I noticed this as my server upload speed is only ~100kB/s; it takes a while (~4mins) to download a 20MB file.
Is there a way to kind of auto-release the lock?

[thorwak]

Reab4, this sounds more like a firefox issue to me?

[Reab4]

indeed. Forget it, seems no issue in Opera.

[thorwak]

Cosmetic: Download speed unit displayed is "KB/s", should be "kB/s" if being pedantic.

[spearhead]

Cosmetic: Download speed unit displayed is "KB/s", should be "kB/s" if being pedantic.

If that's all the trouble you have with the download speed indicator...

[thorwak]

 

I figured it would be nice with something that would be easy to fix for a change 

(True, the figures are also all over the place amount-wise, but that's another story..)

[Reab4]

Do you know what this means:
Error while updating alt.binaries.multimedia: Data stream not terminated with period (0)

Error in the database or while fetching headers?

[spearhead]

Do you know what this means:
Error while updating alt.binaries.multimedia: Data stream not terminated with period (0)

Error in the database or while fetching headers?

It's an error while downloading the headers. The transaction should end with a line with only a period (.) on it. I never encountered it myself tho. Is it recurrent or just a one time thing?

[Reab4]

There are more instances in the log but they may be caused by me killing tasks. I had problems with the multimedia group hanging while updating. This is not a large group and since it, together with the boneless update, was blocking updates for other groups for 10h, I killed the task. It autostarted and hung again at 73% so I killed it again and purged the group, which took quite a while but finished eventually. It re-fetched headers and it quit with the period (0) error. I manually restarted it and now seems ok.
I can't make heads or tails of this behavior - perhaps just a one-time glitch.

[spearhead]

There are more instances in the log but they may be caused by me killing tasks. I had problems with the multimedia group hanging while updating. This is not a large group and since it, together with the boneless update, was blocking updates for other groups for 10h, I killed the task. It autostarted and hung again at 73% so I killed it again and purged the group, which took quite a while but finished eventually. It re-fetched headers and it quit with the period (0) error. I manually restarted it and now seems ok.
I can't make heads or tails of this behavior - perhaps just a one-time glitch.

Sounds weird... I'd like to see a log file of this while in debug mode...

[Reab4]

I'm having problems generating a proper log, due to its size. Is the log stored in a file also?  - anyway - let me know if you need something particular.
(svn 1452)

02 May 2010    08:01:17    DEBUG    read line: [DISKFREE h]
02 May 2010    08:01:17    DEBUG    fn:do_diskfree() pid:23229 (9175040 9437184)
02 May 2010    08:01:17    DEBUG    fn:do_diskfree() pid:23229 (9175040 9437184)
02 May 2010    08:01:17    DEBUG    read line: [DISKFREE p1]
02 May 2010    08:01:14    DEBUG    #6 /usr/share/urd_svn/urdd/urdd.php(337): handle_queue_item(Object(DatabaseConnection), Object(action))
02 May 2010    08:01:14    ERROR    Error while updating alt.binaries.multimedia: Data stream not terminated with period (0)
02 May 2010    08:01:14    DEBUG    #9 {main}
02 May 2010    08:01:14    DEBUG    #5 /usr/share/urd_svn/urdd/urdd.php(139): do_update(Object(DatabaseConnection), Object(action))
02 May 2010    08:01:14    DEBUG    #8 /usr/share/urd_svn/urdd/urdd.php(876): server(Array, Object(DatabaseConnection), Object(server_data))
02 May 2010    08:01:14    DEBUG    #3 /usr/share/urd_svn/functions/nntp.class.php(386): URD_NNTP->get_headers(Array, Resource id #3202, Resource id #3204, Object(action), 1272520041, Resource id #3209, Resource id #3210, true, Resource id #3198, Resource id #3206, 1, '0')
02 May 2010    08:01:14    DEBUG    #0 /usr/share/urd_svn/functions/libs/base_nntp_client.php(1308): Base_NNTP_Client->_getTextResponse()
02 May 2010    08:01:14    DEBUG    #1 /usr/share/urd_svn/functions/libs/nntp_client.php(710): Base_NNTP_Client->cmdFastXOver('486732911-48673...')
02 May 2010    08:01:14    DEBUG    #2 /usr/share/urd_svn/functions/nntp.class.php(263): NNTP_Client->get_fast_overview('486732911', '486734910', false)
02 May 2010    08:01:14    DEBUG    updating status Failed
02 May 2010    08:01:14    DEBUG    #4 /usr/share/urd_svn/urdd/do_functions.php(692): URD_NNTP->update_newsgroup(Array, Object(action))
02 May 2010    08:01:14    DEBUG    #7 /usr/share/urd_svn/urdd/urdd.php(501): check_queue(Object(DatabaseConnection), Object(conn_list), Object(server_data))
02 May 2010    08:01:14    DEBUG    Requeueing paused
02 May 2010    08:01:14    DEBUG    Queueing UPDATE 3
02 May 2010    08:01:14    DEBUG    updating status Paused
02 May 2010    08:01:14    DEBUG    fn:disconnect() pid:29700 (13893632 13893632)
02 May 2010    08:01:14    DEBUG    NNTP Connect error received
02 May 2010    08:01:14    DEBUG    Thread status 1; server: 19
02 May 2010    08:01:14    DEBUG    fn:__destruct() pid:29700 (13893632 13893632)
02 May 2010    08:01:14    DEBUG    fn:disconnect() pid:29700 (13893632 13893632)
02 May 2010    08:01:14    DEBUG    fn:shutdown_handler() pid:29700 (13893632 13893632)
02 May 2010    08:01:14    DEBUG    shutdown handler called as child
02 May 2010    08:01:14    DEBUG    Child exited (rc: 10)
02 May 2010    08:01:13    DEBUG    read line: [PASS XXX]
02 May 2010    08:01:13    DEBUG    read line: [USER Reab4]
02 May 2010    08:01:13    DEBUG    read line: [DISKFREE h]

01 May 2010    19:20:09    DEBUG    #6 /usr/share/urd_svn/urdd/urdd.php(337): handle_queue_item(Object(DatabaseConnection), Object(action))
01 May 2010    19:20:09    DEBUG    #5 /usr/share/urd_svn/urdd/urdd.php(139): do_update(Object(DatabaseConnection), Object(action))
01 May 2010    19:20:09    DEBUG    #7 /usr/share/urd_svn/urdd/urdd.php(501): check_queue(Object(DatabaseConnection), Object(conn_list), Object(server_data))
01 May 2010    19:20:09    DEBUG    #8 /usr/share/urd_svn/urdd/urdd.php(876): server(Array, Object(DatabaseConnection), Object(server_data))
01 May 2010    19:20:09    DEBUG    #9 {main}
01 May 2010    19:20:09    DEBUG    #4 /usr/share/urd_svn/urdd/do_functions.php(692): URD_NNTP->update_newsgroup(Array, Object(action))
01 May 2010    19:20:09    ERROR    Error while updating alt.binaries.mom: Data stream not terminated with period (0)
01 May 2010    19:20:09    DEBUG    updating status Failed
01 May 2010    19:20:09    DEBUG    #0 /usr/share/urd_svn/functions/libs/base_nntp_client.php(1308): Base_NNTP_Client->_getTextResponse()
01 May 2010    19:20:09    DEBUG    #1 /usr/share/urd_svn/functions/libs/nntp_client.php(710): Base_NNTP_Client->cmdFastXOver('794754714-79475...')
01 May 2010    19:20:09    DEBUG    #2 /usr/share/urd_svn/functions/nntp.class.php(263): NNTP_Client->get_fast_overview('794754714', '794756713', false)
01 May 2010    19:20:09    DEBUG    #3 /usr/share/urd_svn/functions/nntp.class.php(386): URD_NNTP->get_headers(Array, Resource id #144396, Resource id #144399, Object(action), 1272300988, Resource id #144404, Resource id #144405, true, Resource id #144393, Resource id #144401, 1, '0')
01 May 2010    19:20:09    DEBUG    Queueing UPDATE 7293
01 May 2010    19:20:09    DEBUG    Thread status 1; server: 19
01 May 2010    19:20:09    DEBUG    NNTP Connect error received
01 May 2010    19:20:09    DEBUG    Requeueing paused
01 May 2010    19:20:09    DEBUG    updating status Paused
01 May 2010    19:20:09    DEBUG    Child exited (rc: 10)
01 May 2010    19:20:09    DEBUG    fn:disconnect() pid:6175 (13893632 13893632)
01 May 2010    19:20:09    DEBUG    fn:__destruct() pid:6175 (13893632 13893632)
01 May 2010    19:20:09    DEBUG    shutdown handler called as child
01 May 2010    19:20:09    DEBUG    fn:disconnect() pid:6175 (13893632 13893632)
01 May 2010    19:20:09    DEBUG    fn:shutdown_handler() pid:6175 (13893632 13893632)
01 May 2010    19:20:07    DEBUG    read line: [PASS XXX]
01 May 2010    19:20:07    DEBUG    Incoming connection from host localhost:60063
01 May 2010    19:20:07    DEBUG    read line: [DISKFREE h]
01 May 2010    19:20:07    DEBUG    read line: [USER Reab4]
01 May 2010    19:20:07    DEBUG    read line: [DISKFREE p1]
01 May 2010    19:20:07    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:20:07    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:20:03    DEBUG    read line: [USER Reab4]
01 May 2010    19:20:03    DEBUG    read line: [PASS XXX]
01 May 2010    19:20:03    DEBUG    Incoming connection from host localhost:60062

01 May 2010    19:16:47    DEBUG    Incoming connection from host localhost:59985
01 May 2010    19:16:47    DEBUG    read line: [DISKFREE h]
01 May 2010    19:16:47    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:47    DEBUG    read line: [DISKFREE p1]
01 May 2010    19:16:47    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:43    DEBUG    read line: [PASS XXX]
01 May 2010    19:16:43    DEBUG    read line: [USER Reab4]
01 May 2010    19:16:43    DEBUG    Incoming connection from host localhost:59984
01 May 2010    19:16:43    DEBUG    read line: [DISKFREE h]
01 May 2010    19:16:43    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:43    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:43    DEBUG    read line: [DISKFREE p1]
01 May 2010    19:16:41    WARNING    Cannot get messages:
01 May 2010    19:16:41    DEBUG    fn:disconnect() pid:6175 (13893632 13893632)
01 May 2010    19:16:41    ERROR    Data stream not terminated with period (0)
01 May 2010    19:16:39    DEBUG    read line: [PASS XXX]
01 May 2010    19:16:39    DEBUG    Incoming connection from host localhost:59981
01 May 2010    19:16:39    DEBUG    read line: [DISKFREE h]
01 May 2010    19:16:39    DEBUG    read line: [USER Reab4]
01 May 2010    19:16:39    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:39    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:39    DEBUG    read line: [DISKFREE p1]
01 May 2010    19:16:35    DEBUG    read line: [PASS XXX]
01 May 2010    19:16:35    DEBUG    Incoming connection from host localhost:33773
01 May 2010    19:16:35    DEBUG    read line: [DISKFREE h]
01 May 2010    19:16:35    DEBUG    read line: [USER Reab4]
01 May 2010    19:16:35    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:35    DEBUG    fn:do_diskfree() pid:21719 (9175040 9175040)
01 May 2010    19:16:35    DEBUG    read line: [DISKFREE p1]
01 May 2010    19:16:31    DEBUG    read line: [PASS XXX]

[spearhead]

yes it is typically in /tmp/urdd.log (you can also switch to syslog if you want)

anyway... it looks from what I gather from the log, a bit to me like the server is terminating the connection or aborting the header sequence...