In the installation the download dir is one of the options you'd have to fill in. Or you can set it afterwards under admin/confic/URD Daemon. This however will not change the open_basedir settings of php in any way. You'd have to fix the open_basedir settings manually by editting the php.ini file. The installer only checks if this value is blank (which means no restrictions) for the moment. The URD daemon will check at startup if it has access to all the directories it needs and if not, stops with an error (log file is in /tmp/urdd.log).

I never use open_basedir. However from the php documentation  I gather you'd also need to include the download directory in the open_basedir statement.

After autoconfig it will usually try to restart after it finished, but the restart sometimes fails. And you have to start it manually then.

The autoconfig will find the servers but not set the username/password this you'd
have to do manually in admin/usenet servers, by clicking on the tool icon on the right. You have to set "needs authentication", "username" _and_ "password". After that the group list can be run on the server selected as the indexing server.

In case it doesn't work please send the relevant part of the log file (under admin/logfile)

First you should enable one or more usenet server by clicking in admin/usenet servers on one of the red button to the left and enable indexing for one of them. You can press the edit button right to set a username/password if needed. If your newsserver is not there yet, you can add one under actions/add new. (please post/pm the name, hostname and port)

A group update should run automatically, if the above is successful. Otherwise check admin /tasks and kill the groups command, then re-run it manually under admin/dashboard. The grouplist shou/ld appear under settings/newsgroups. From there you can subscribe one or more for indexing. The reslts are shown under supply/groups. Alternatively you can start using spots under supply; click actions/update to update them.

I think I oughta update the manual a bit or two some time.

Let me know if you run in any trouble.

the error you get is a package error, it doesn't actually look for files afaik.
You can probably use this option for dpkg:
--ignore-depends=yydecode

alternatively you can get .deb from one of the mirrors of getdeb for 12.04

Well it's a two step process after the update function that gets the articles from the newsgroup server.
First articles are grouped to binaries
Then binaries are grouped into sets
Essentially it looks for specific similarities in the subject to combine them.

If it slow the first thing to do is look at the database settings. Running mysqltuner.pl might help to finetune this. Mostly index buffers are the key performance aspect here, which means the more memory the better. By default mysql is rather conservative in memory usage. CPU isn't that important really.
wget mysqltuner.pl

The code is quite straight forward, but I've been running many algorithms in the past but setting on the current one as it seems to be the fastest on average.

one thing to look at is the spam filter, which will throw a way a huge set of data. For groups like  a.b.x264  you may set it to 1M or larger even 100M but then you might miss some sets that are still largely incomplete.

I added this to the comments field for now; visible under admin/tasks

I'll look into it if it is doable.

In part, but the completeness is not always really correct. E.g. no a .par2 is missing or a sample or whatever. Sometimes it is just 99 percent.
the completeness is also shown in the overview (the globe on the right)

May affect the number of sets shown quite a bit. Lower it to 80 or so.

Code:

setcompleteness   100

It can be found under user prefs

Also some options are hidden; you can unhide them by setting the
User experience level:

And yeah there are a lot of options

It puzzles me a bit. I see e.g. 89 spots in my URD for "expendables" .
The number of sets is also displayed in the spots/groups/rss page in the group selector between (). And the number of articles is shown in settings/groups

Are there any errors in the log file (under admin/log)?

You might wanna switch to debug mode for URDD (under admin/configuration/globalsettings/log level). You should see messages like
Dec 12 23:20:45 cenotaph urdd: DEBUG Estimated header count: 4145
Dec 12 23:20:45 cenotaph urdd: DEBUG Getting articles 3541562 - 3557564
Dec 12 23:20:45 cenotaph urdd: DEBUG Getting headers 3547564 - 3557564
Dec 12 23:21:11 cenotaph urdd: NOTICE Total updated binaries in alt.binaries.sounds.mp3.extreme-metal is 189
et cetera
there should be no error messages

URD however does aggregate info somewhat different than most other indexers I've seen. But the difference should be that small. And there are some filter settings, e.g. min/max set size and spam count per group under settings/newsgroups/ user or global. As well as some global (default) settings under admin/config for min/max setsize and a filter on the set completeness

Perhaps you can post / PM the debug output under help/debug .. and I'll have a look

btw if it works please provide the settings so I can add them to the list

I never tried usenext.de really. But you should be able to use any usenet provider. If it is not in the list you can added under admin/usenet-servers/actions/add new

This topic has been moved to Technical Problems.

http://urdland.com/forum/index.php?topic=645.0

It should be on the same system as where URD is installed. Otherwise it can be any directory. Rights should be set so that www-data can access it (rwx). E.g.

Code:

mkdir /data/download/
chgrp www-data /data/download/
chmod 775 /data/download/

Should be sufficient. If you fill in /data/download/ in the installer. It only checks if the dir exists and if it is writable.

-u is a system user name, not an URD name. So on ubuntu like systems you'd probably want to put
/usr/share/urd/urdd.sh -D -u www-data
in rc.local.
Then it should drop privileges to the same user as the web browser, and behaves as if started from the web browser. If you used to start it from the command line you can also use the login name for your linux install.

if there are any errors you should be able to find them in /tmp/urdd.log

 

the easiest way to do it is add a line to /etc/rc.local, eg

/usr/share/urd/urdd.sh -D

You might run into some rights issues. You could add -u to set a user to fix that.

Okay I see the issue. Thanx for reporting this:

In the file html/ajax_spots.php at line 213 change

Code:

$Qspamlimit = " AND \"reports\" < $spam_limit ";

to

Code:

    $Qspamlimit = " AND (\"reports\" < $spam_limit OR \"reports\" IS NULL) ";

Seems like there is a little bug in the admin page. I thnk you have disabled Synchronising extended set information:  under the modules tab. Enable it and it should appear

It's under admin/config/setupdating as Expire after update. It should be on by default.
Expire is typically run after an update and will remove all "old" entries from the database. You can see in tasks whether it has run indeed.

Expire time can be set per group in settings/newsgroup on the global settings tab. (note for the spots groups free.pt/free.usenet/free.wiley you have to explicitly search for those in newsgroups)
I do recommend to schedule an optimise database weekly or so to retain that snappy database (due to fragmentation).

ipv4 or 6 shouldn't matter apart from the syntax of ip addresses. At least when IPv6 is working.

That's pretty odd since the urd daemon has barely changed, esp with regard to the downloading / spots code. ANd before I released 1.4.0 I did a clean install myself on a fresh ubuntu machine (12.4 IIRC) withouth any problems. But I'll have a look at the start-up code and see if there are any issues there.

One more thing:  I see groups is paused in the queue. That is usually not a good sign. Try and kill it in admin/tasks (use the trashcan if necessary). Then try to restart updating groups again. (restarting urdd may help too in between killing and updating) (pressing play may also work, but may also push it quickly back on the queue as paused again.

Code:

#1. id:8 u:Sebastian p:50 cmd:GROUPS paused qt:1506.4244818687

Can you modify the flie urdd/do_functions and add the line

Code:

        echo_debug_trace($e, DEBUG_SERVER);

after the line

Code:

        write_log('Update failed '. $e->getMessage(), LOG_WARNING);

in the function

Code:

function do_getspots(DatabaseConnection $db, action $item)

should be line 2353

Then run it again and post the debug output again?

I 'll have a look at the code. It's a bit strange behaviour I can't really reproduce. But it seems to happen after updating something. I don't see anything odd in the debug nor the log at first glance.

In the mean time there is one more thing you might wanna try.

In admin/tasks press "cancel all tasks", then press "clear all volatile data"
Then press the trashcan on all tasks still present there.
Then turn off urdd
Turn it back on. In the logs there should be NO "restored FOO" messages. If there are there is still something running. Proceed as above.
Then reget the groups list and try to get the spots again.

If you know how, you can clear the groups list in mysql by logging in to the mysql console and run truncate groups; on the database. (or just use phpmyadmin or sth)

Interesting.... can you post/pm a log file with the log level set to debug (in adminc/config/ global settings), preferably from the start of urdd.

Also if there is an issue with the database, you might want to try to run this script

Code:

php install/update_db.php

(under the urd tree) to see and fix if the db is correct.

Also check help/debug informuatien if there are any issues there. Or post/pm it and I'll  a look