Clomps conf: Difference between revisions

From Lundman Wiki
No edit summary
mNo edit summary
 
Line 1: Line 1:
=== Vancouver ===
# Which FXP.One to connect to. Omit PASS to have app prompt for passwd.
FXPONE|HOST=server.that.runs.fxpone.com|PORT=8885|USER=admin|PASS=admin|ssl=forced


* Vancouver science museum [http://www.scienceworld.ca/]
Define where to connect for the FXP.One engine. It can be the same server as clomps run on, use localhost. If you leave the '''PASS=''' out, then clomps will prompt for passwords.
* Airport hotel? for 15th and 16th. Days Inn Vancouver Airport, Richmond booked
'''ssl=forced''' on this line refers to the connection to the engine. Encryption is a good idea, except if you are using localhost, and nobody else has root on your server.
# Define sites and paths.
SITE|NAME=ASite1|DIR=/x264-tv/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s|TIMEFILE=.asite.timestamp
SITE|NAME=Another|DIR=/tv-x264/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s|HIDE=American.Idol*
SITE|NAME=Another|HIDE=Additional*/*HideStrings*
SITE|NAME=glftpdSite|DIR=/tv-x264/|USESKIP=1|INCTEST=(INCOMPLETE)-%s|NUKETEST=!NUKED-%s
  SITE|NAME=home|DIR=/tv/|DIR=/drive2/tv/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s


=== Toronto ===
Here we define the sites to connect to, and which directories to list. Note that '''home''' has two directories listed, they are combined.
TIMEFILE=filename can specify the timestamp file, if left out, clomps will make it based on the config filename + .timestamp


Toronto - Medieval times restaurant
If you run this clomps.conf now, you will get an output like:
http://www.medievaltimes.com/toronto.aspx


[http://www.localsknow.ca/?sortby=popular locals know]
./clomps -vf example.conf
  http://www.mbam.qc.ca/en/expositions/a-venir/faberge
connected to FXP.One
successfully negotiated SSL
Successfully connected to FXP.One
Site glftpdSite processing dir '/tv-x264/'
Site home processing dir '/tv/'
Site Another processing dir '/tv-x264/'
Site ASite1 processing dir '/x264-tv/'
  Site home processing dir '/drive2/tv/'
      Another finished processing: 111 files (  1/ 4)
          home finished processing: 3135 files (  2/ 4)
    glftpdSite finished processing:  158 files (  3/  4)
        ASite1 finished processing:  166 files (  4/  4)
-----======> DISPLAY MATRIX <======-----
T |ASite|Anoth|glftp|home | New Items
--+-----+-----+-----+-----+-----------
d |INC  |MISS |MISS |MISS | Best.Laid.Plans.2012.1080p.BluRay.X264-7SinS
d |INC  |MISS |MISS |MISS | To.Catch.A.Thief.1955.1080p.BluRay.x264-HD4U
d |    |MISS |MISS |MISS | The.Summer.Of.Massacre.2011.720p.BluRay.x264-UNTOUCH
ABLES
d |    |MISS |NUKE |MISS | Under.Still.Waters.2008.720p.BluRay.x264-SWAGGERHD
Which shows new releases, by showing up (names on the right side) they exist somewhere. Any site column with a blank entry, means the release is there and complete. '''INC''' means that the release is incomplete (INCTEST patten matches), and similarly '''NUKE''' means nuked. '''MISS''' means this release is not on this site.


* rent car 17th to 28th (~17:00)


=== America ===
=== Automatic queueing ===


Proposed trip to Canada USA in Summer 2011. We are staying in Waupoos Island, and need to stop in Toronto, and Boston.
In addition to finding new entries, you can ask clomps to create queues. The queue lines are defines with '''pass number'''. Starting from 1. This means, all queue lines with pass=1 will be started at the same time. Once all pass=1 transfers are complete, clomps will run pass=2. This allows for all-concurrent queueing, or, sequentially queueing.  


Since we are in the area, we might as well stop by Niagara Falls. According to Google it is only 4 hours from Boston to New York City. So it would seem prudent to get NYC over with.
For example (Spaces added between '|' separator for readability):


Proposed route:
AUTOQ|PASSNUM=1|FROM=glftpdSite|TO=ASite1 | ACCEPT=the.simpson*/family.guy*/american.dad*/How?I?met?your?mother* | REJECT=*FINSUB*/*AC3* | INCSKIP
CONTINUED|ACCEPT=House*/firefly*
CONTINUED|ACCEPT=orphan.black*|REJECT=*webrip*


[http://maps.google.com/maps/ms?hl=en&ie=UTF8&t=h&msa=0&msid=110604077924445277589.00048b26bb0a29bc54770&z=6 Google]
Which would automatically transfer items from '''glftpdSite''' "/tv-x264/", to '''ASite1''' "/x264-tv/". But only releases matching "the.simpson*" etc, unless they are *FINSUB* etc. The '''INCSKIP''' tells clomps not to transfer things that are incomplete. Clomps will then only transfer completed-releases. If you remove '''INCSKIP''' clomps will start to move incomplete releases as well.


Areas of interest, and possible sleep overs.
The right-hand side in ACCEPT and REJECT statements are slash-separated list of matches. Ie, "*simpsons*/blue.planet*" would match on "*simpsons*" and "blue.planet*", with glob-style pattern matching. This means "I.hate.simpsons" would match (in the middle) but "the.blue.planet" would not (since it was not "*blue.planet*". No starting "*"). Note that this would also fail on "Blue_Planet" and "blue planet", since the period "." is literal. The best way is to use "blue?planet*".  All matches are '''case-insensitive'''.


Niagara Falls
CONTINUED lines, can add to the ACCEPT and REJECT lines if placed after an AUTOQ command. It is for readability and flexibility.
NYC: Time Square
NYC: Central Park
NYC: Nat.History Museum
NYC: Statue of Liberty, don't care to go to Liberty Island, but at least see it from afar. Can you see it from Jersey turnpike?
Letchworth national park
Dorian Lake theme park


Six Flags Great Adventure, Jackson, New Jersey- Just an 80-minute drive from Manhattan sits the largest theme park in the world. Six Flags Great Adventure features 12 monster roller coasters and includes a Wild Safari. There is also Six  Flags Hurricane Harbor right next door (the largest water park in the Northeast). New Jersey Transit also provides bus service from the Port Authority Bus Terminal in Manhattan when the park is open (May-October).


  Jersey Shore, New Jersey- The Jersey Shore starts just a few miles south of New York City. It stretches for almost 130 miles, and along it are private and public beaches. There are numerous activities along the Jersey Shore. A convenient train ride on the NJ Transit trains from Penn Station will get you to several of the towns on the Jersey Shore, including Manasquan and Point Pleasant Beach.
  AUTOQ|PASSNUM=2|FROM=ASite1|TO=home | ACCEPT=* | REJECT=*dvdrip*


Long Island— When you travel to NYC in the summer, a great idea is to check out Long Island. With its beautiful long white sanded beaches you can have it all: the big city and the summer holiday. Many New Yorkers do that every Friday, Saturday and Sunday if it is hot. Take the Long Island Rail Road from Penn Station to Long Beach ($6.75 one way), and from there go south to the beach itself. Take a day trip on the Hampton Jitney from various stops in NYC to the East End, where Long Island wine country is on the North Fork and The Hamptons are on the South Fork.
After pass=1 has completed, move '''everything''' from '''ASite1''' to home. Except for dvdrips. Incompletes will also be started.
 
 
NYC: Grand Central Station?
NYC: Central Zoo
NYC: The Cloisters
 
* NYC hotel on 26th - Salisbury hotel
 
* LAX hotel on 29th.
* rent car LA, 28th 29th.
 
*  The Kidspace Children’s Museum in Pasadena
* Science museum
* Tar pits
* Anaheim water park

Latest revision as of 07:18, 14 May 2014

# Which FXP.One to connect to. Omit PASS to have app prompt for passwd.
FXPONE|HOST=server.that.runs.fxpone.com|PORT=8885|USER=admin|PASS=admin|ssl=forced

Define where to connect for the FXP.One engine. It can be the same server as clomps run on, use localhost. If you leave the PASS= out, then clomps will prompt for passwords. ssl=forced on this line refers to the connection to the engine. Encryption is a good idea, except if you are using localhost, and nobody else has root on your server. 

# Define sites and paths.
SITE|NAME=ASite1|DIR=/x264-tv/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s|TIMEFILE=.asite.timestamp
SITE|NAME=Another|DIR=/tv-x264/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s|HIDE=American.Idol*
SITE|NAME=Another|HIDE=Additional*/*HideStrings*
SITE|NAME=glftpdSite|DIR=/tv-x264/|USESKIP=1|INCTEST=(INCOMPLETE)-%s|NUKETEST=!NUKED-%s
SITE|NAME=home|DIR=/tv/|DIR=/drive2/tv/|USESKIP=1|INCTEST=%s-(INCOMPLETE)|NUKETEST=NUKED-%s

Here we define the sites to connect to, and which directories to list. Note that home has two directories listed, they are combined. TIMEFILE=filename can specify the timestamp file, if left out, clomps will make it based on the config filename + .timestamp

If you run this clomps.conf now, you will get an output like: 

./clomps -vf example.conf

connected to FXP.One
successfully negotiated SSL
Successfully connected to FXP.One
Site glftpdSite processing dir '/tv-x264/'
Site home processing dir '/tv/'
Site Another processing dir '/tv-x264/'
Site ASite1 processing dir '/x264-tv/'
Site home processing dir '/drive2/tv/'
      Another finished processing:  111 files (  1/  4)
         home finished processing: 3135 files (  2/  4)
   glftpdSite finished processing:  158 files (  3/  4)
       ASite1 finished processing:  166 files (  4/  4)


-----======> DISPLAY MATRIX <======-----

T |ASite|Anoth|glftp|home | New Items
--+-----+-----+-----+-----+-----------
d |INC  |MISS |MISS |MISS | Best.Laid.Plans.2012.1080p.BluRay.X264-7SinS
d |INC  |MISS |MISS |MISS | To.Catch.A.Thief.1955.1080p.BluRay.x264-HD4U
d |     |MISS |MISS |MISS | The.Summer.Of.Massacre.2011.720p.BluRay.x264-UNTOUCH
ABLES
d |     |MISS |NUKE |MISS | Under.Still.Waters.2008.720p.BluRay.x264-SWAGGERHD

Which shows new releases, by showing up (names on the right side) they exist somewhere. Any site column with a blank entry, means the release is there and complete. INC means that the release is incomplete (INCTEST patten matches), and similarly NUKE means nuked. MISS means this release is not on this site.


Automatic queueing

In addition to finding new entries, you can ask clomps to create queues. The queue lines are defines with pass number. Starting from 1. This means, all queue lines with pass=1 will be started at the same time. Once all pass=1 transfers are complete, clomps will run pass=2. This allows for all-concurrent queueing, or, sequentially queueing.

For example (Spaces added between '|' separator for readability): 

AUTOQ|PASSNUM=1|FROM=glftpdSite|TO=ASite1 | ACCEPT=the.simpson*/family.guy*/american.dad*/How?I?met?your?mother* | REJECT=*FINSUB*/*AC3* | INCSKIP
CONTINUED|ACCEPT=House*/firefly*
CONTINUED|ACCEPT=orphan.black*|REJECT=*webrip*

Which would automatically transfer items from glftpdSite "/tv-x264/", to ASite1 "/x264-tv/". But only releases matching "the.simpson*" etc, unless they are *FINSUB* etc. The INCSKIP tells clomps not to transfer things that are incomplete. Clomps will then only transfer completed-releases. If you remove INCSKIP clomps will start to move incomplete releases as well.

The right-hand side in ACCEPT and REJECT statements are slash-separated list of matches. Ie, "*simpsons*/blue.planet*" would match on "*simpsons*" and "blue.planet*", with glob-style pattern matching. This means "I.hate.simpsons" would match (in the middle) but "the.blue.planet" would not (since it was not "*blue.planet*". No starting "*"). Note that this would also fail on "Blue_Planet" and "blue planet", since the period "." is literal. The best way is to use "blue?planet*". All matches are case-insensitive.

CONTINUED lines, can add to the ACCEPT and REJECT lines if placed after an AUTOQ command. It is for readability and flexibility. 


AUTOQ|PASSNUM=2|FROM=ASite1|TO=home | ACCEPT=* | REJECT=*dvdrip*

After pass=1 has completed, move everything from ASite1 to home. Except for dvdrips. Incompletes will also be started.

Retrieved from "http://lundman.net/wiki/index.php?title=Clomps_conf&oldid=4529"