Computers & Electronics

Newznab - Personal Usenet Indexer Help Thread

  • Last Updated:
  • Jul 31st, 2013 2:46 am
Tags:
None
Newbie
Apr 17, 2008
32 posts
7 upvotes
Sithquest wrote:
Dec 27th, 2012 12:19 pm
I have questions regarding your regexp's for filtering out junk releases. if you put ^[a-zA-Z0-9]{20}$ in as a blacklist it does accept it.. but if you try and test it within Newznab via the View Add Test Send Regex menu it has PHP errors and doesn't actually show anything.. from http://php.net/manual/en/regexp.referen ... miters.php it says you must use delimiters.. often slashes (/)...

I tried this to filter out some junk releases with common patterns I noticed.. for example - Ondahaaoa-921646696-201212280217 i used ^[a-zA-Z]{9}[+-][0-9]{9}[+-][0-9]{12}$ which does work when using http://regexpal.com/ it does filter when using mySQL.. but fails with PHP errors with newznab when testing in admin.. I tried adding "/" add the start and end but nothing.. If you have any idea that would be awesome.. Thanks!
I'm interested in this response too, my regex blacklists don't seem to be working too.
Deal Addict
User avatar
Apr 4, 2003
4668 posts
83 upvotes
Oakville
Mardos wrote:
Dec 28th, 2012 7:53 pm
http://nzbforu.com/ still work in progress
Im currently in the process of uploading all TV Shows also working on editing the pictures and etc.
Aren't you worried about takedown requests like what shut down NZBMATRIX?
Newbie
Jan 2, 2013
2 posts
I followed the How to Geek guide for setting up Newznab in Ubuntu and it's working a treat. However, there is one last thing that I want to do before being able to call this project to a close.

Does anyone know if it possible to run Newznab in Daemon mode on Ubuntu so that I don't have to keep manually running the update scripts?

My Usecase is that I want to be able to dynamically activate new groups and/or increase backfill days and not have to worry about manually executing the scripts.

I'd appreciate any help anyone can provide.
Newbie
Jan 2, 2013
2 posts
Mardos wrote:
Dec 20th, 2012 8:22 am
I highly recommend spending the $15USD and getting the PLUS. You wont regret it, I have mine running, you can also add cron jobs to your ubuntu for automated update binaries and releases :)
Can you please tell me how to setup the jobs to run automatically?
Deal Addict
Jun 8, 2005
2530 posts
219 upvotes
dtb801 wrote:
Jan 3rd, 2013 10:15 am
Can you please tell me how to setup the jobs to run automatically?
Add them to your crontab. Google if it you need more information, not exactly rocket science.
Deal Addict
User avatar
Nov 8, 2002
4989 posts
418 upvotes
Mardos wrote:
Dec 28th, 2012 7:53 pm
http://nzbforu.com/ still work in progress
Im currently in the process of uploading all TV Shows also working on editing the pictures and etc.
You're using FrogHost for hosting? It looks like they're a shared hosting provider (the link to VPS hosting on their site points to a different company). I'll assume that you'll get booted from that host in the near future (esp because your site is public). Careful.
Newbie
Apr 17, 2008
32 posts
7 upvotes
Well, answering my own questions, for references for others...

Regex are done on binaries, not on releases name.

So instead of ^[a-zA-Z]{9}[+-][0-9]{9}[+-][0-9]{12}$, you can use [a-zA-Z]{9}[+-][0-9]{9}[+-][0-9]{12} (Without the "startwith" and "endby") and it should work. Of course, for this regex, the possiblity of hitting another correct post is near zero, but for more simple regex, you should create a more complete regex from the binaries, not the release name.
Member
User avatar
Aug 6, 2009
476 posts
45 upvotes
Mardos wrote:
Jan 4th, 2013 10:35 am
no do not use crontab
Why not? Mine is on 30 minute update cycles and seems to be working... ?
Deal Addict
User avatar
Nov 8, 2002
4989 posts
418 upvotes
Mardos wrote:
Jan 4th, 2013 10:36 am
No I have a dedicated server with OVH, domain is from Froghost
Ah OVH is pretty good (price wise and going by some other types of sites they host).
Newbie
Sep 8, 2005
82 posts
3 upvotes
Did anyone grab that blacklist sql list? I wouldn't mind taking a look.

Also if someone bought newznab+, would they be able to sell their key? I'd like to hopefully by someone's key for a discount if they decided it wasn't worth the effort. Not sure where to look for a used one though.
Newbie
Jan 6, 2013
2 posts
BELLEVILLE
routehero wrote:
Dec 23rd, 2012 8:34 am
The most important thing for me is that sickbeard/couchpotato are still flying along without any issue.
I can't get my Sickbeard to find anything on my localhost setup. I'm not getting any errors, it just says 'nothing new found'...and I can see releases in my index.
Newbie
Jan 6, 2013
2 posts
BELLEVILLE
Gochris wrote:
Jan 4th, 2013 10:48 pm
Did anyone grab that blacklist sql list? I wouldn't mind taking a look.
Same here. I'm still a little fuzzy with the format of the blacklists.
Deal Addict
Dec 9, 2006
1252 posts
85 upvotes
Here is the blacklist that was posted before and since removed. It is just a text file saved as .sql

Code: Select all


-- MySQL dump 10.14  Distrib 5.5.28a-MariaDB, for debian-linux-gnu (x86_64)
--
-- Host: localhost    Database: newznab
-- ------------------------------------------------------
-- Server version	5.5.28a-MariaDB-a1~precise

/*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */;
/*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */;
/*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */;
/*!40101 SET NAMES utf8 */;
/*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */;
/*!40103 SET TIME_ZONE='+00:00' */;
/*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */;
/*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */;
/*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */;
/*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */;

--
-- Table structure for table `binaryblacklist`
--

DROP TABLE IF EXISTS `binaryblacklist`;
/*!40101 SET @saved_cs_client     = @@character_set_client */;
/*!40101 SET character_set_client = utf8 */;
CREATE TABLE `binaryblacklist` (
  `ID` int(11) unsigned NOT NULL AUTO_INCREMENT,
  `groupname` varchar(255) COLLATE utf8_unicode_ci DEFAULT NULL,
  `regex` varchar(2000) COLLATE utf8_unicode_ci NOT NULL,
  `msgcol` int(11) unsigned NOT NULL DEFAULT '1',
  `optype` int(11) unsigned NOT NULL DEFAULT '1',
  `status` int(11) unsigned NOT NULL DEFAULT '1',
  `description` varchar(1000) COLLATE utf8_unicode_ci DEFAULT NULL,
  PRIMARY KEY (`ID`)
) ENGINE=MyISAM AUTO_INCREMENT=100035 DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci;
/*!40101 SET character_set_client = @saved_cs_client */;

--
-- Dumping data for table `binaryblacklist`
--

LOCK TABLES `binaryblacklist` WRITE;
/*!40000 ALTER TABLE `binaryblacklist` DISABLE KEYS */;
INSERT INTO `binaryblacklist` VALUES (1,'alt.binaries.boneless','usenet-4all|u4all|usenet4all',1,2,0,'only allow u4all posts in boneless'),(2,'alt.binaries.*','german|french|danish|spanish|flemish|dutch|swedish|swesub|deutsch|nl\\.?sub|norwegian|\\.ita\\.',1,1,0,'do not index non-english language binaries'),(100001,'alt.binaries.*','german|french|danish|spanish|flemish|dutch|swedish|swesub|deutsch|nl\\.?sub|norwegian|\\.ita\\.',3,1,0,'do not index non-english language binaries'),(100007,'alt.binaries.cores','xxx',3,1,0,'Removes XXX.'),(100008,'alt.binaries.cores','xxx',1,1,0,'Removes XXX.'),(100003,'alt.binaries.ghosts','xxx',3,1,0,'removes xxx'),(100004,'alt.binaries.ghosts','xxx',1,1,0,'removes xxx'),(100005,'alt.binaries.mom','xxx',3,1,0,'Removes XXX.'),(100006,'alt.binaries.mom','xxx',1,1,0,'Removes XXX.'),(100010,'alt.binaries.multimedia','nosendemails@me.com|The Phantom|xslidian@hmlt|tim96|GeorgBaer|knt',2,1,1,'Deletes crap'),(100030,'alt.binaries.movies.xvid','theknife',2,1,0,NULL),(100020,'alt.binaries.hdtv.x264','Turkish|CyTSuNee|NZBRoyalty|German',1,1,0,NULL),(100015,'alt.binaries.*','^[^.^ ]{10,20}$',1,1,0,'Filters out all hashes between 10 and 20 characters, that haven\'t got a space, period or caret in them, a negated character class that starts with a ^, doesn\'t have a ^ before every character.'),(100017,'alt.binaries.tv','6UL85|XA7MY',1,1,0,'Removes crap.'),(100027,'alt.binaries.*','TheMaker|gilf|lordsofusenet|klaus|ihate|aart|my2cents|ISNOGOOD|Captain Jack',2,1,0,'VIRUS POSTERS'),(100016,'alt.binaries.*','^[a-z0-9]{20}',1,1,0,'Removes crap.'),(100019,'alt.binaries.hdtv.x264','zed|ich',2,1,0,'Removes crap.'),(100022,'alt.binaries.*','TrollHD|Olympics|Serbian|NASCAR|damike99',1,1,0,NULL),(100023,'alt.binaries.*','NovaRip',1,1,0,NULL),(100024,'alt.binaries.*','NoTHing|9NoTHing|EveryFinG',1,1,0,NULL),(100025,'alt.binaries.*','seizoen|nomytnopyht',1,1,0,NULL),(100026,'alt.binaries.*','CowboyUp26|gr4ndstre4m|CowboyUp2012|trein',1,1,0,NULL),(100028,'alt.binaries.*','CPP-Gebruiker',2,1,0,'foreign'),(100029,'alt.binaries.hdtv','[Password]',1,1,0,NULL),(100011,'alt.binaries.multimedia','FLEMISH|iRLS\\\\HYBRiS|FR|NORWEGIAN|Liga|DUTCH|EUFA|Footy|GERMAN|NRL|Snoballkrigen!ATKGalleria|RealCo|[MP4SUX]|',1,1,0,NULL),(100031,'alt.binaries.teevee','GERMAN|german',1,1,0,NULL),(100018,'alt.binaries.tv','german|danish|flemish|dutch|swedish|swesub|deutch|nl\\\\.?sub|norwegian|DEFA|Knochen',1,1,0,NULL),(100021,'alt.binaries.*','NoTHing',2,1,0,NULL),(100014,'alt.binaries.*','^[a-z0-9]{1,80}([0-9-]+$|$)',1,1,0,'Hashed Releases.'),(100032,'alt.binaries.*','AutoRarPar\\d',1,1,0,'Removes releases with AutoRarPar\\d in the name.'),(100033,'alt.binaries.*','(^|[.\\/ \\-]+)(sie|seit|ihn|ihm|haben|besitzen|sein|kriegen|nehmen|welche|jenes|von|auf|gegen|nach|das|sein|der|und|fuer|ersten|leicht|meinem|zum|aus|dem|blitzlicht|alle|grosse|zed|ich|sed|blitzen)([.\\/ \\-]+|$)',1,1,0,'Removes many german releases.'),(100034,'alt.binaries.*','[aeiouy]{4,80}',1,1,0,'Removes multiple vowels strung together. See: http://blog.phile.biz/post/39106364519/useful-blacklist-rules');
/*!40000 ALTER TABLE `binaryblacklist` ENABLE KEYS */;
UNLOCK TABLES;
/*!40103 SET TIME_ZONE=@OLD_TIME_ZONE */;

/*!40101 SET SQL_MODE=@OLD_SQL_MODE */;
/*!40014 SET FOREIGN_KEY_CHECKS=@OLD_FOREIGN_KEY_CHECKS */;
/*!40014 SET UNIQUE_CHECKS=@OLD_UNIQUE_CHECKS */;
/*!40101 SET CHARACTER_SET_CLIENT=@OLD_CHARACTER_SET_CLIENT */;
/*!40101 SET CHARACTER_SET_RESULTS=@OLD_CHARACTER_SET_RESULTS */;
/*!40101 SET COLLATION_CONNECTION=@OLD_COLLATION_CONNECTION */;
/*!40111 SET SQL_NOTES=@OLD_SQL_NOTES */;

-- Dump completed on 2013-01-03 11:47:52


× < >

Top