The Vault Preservation Project

[Legacy_Rolo Kipp]

                <flashing back...>

Do you remember the start of the music video for one of the Eurythmics' songs? A very tall man walks up and says "Not wanting to waste your valuable time..."

Heh.

I'm at that point here, thanks to Acomputerdude :-P The perl script he wrote is now quietly churning away in the background as I write (It's taken all week, but I've so far grabbed up to #7800 (out of 8170-something) hakpaks.

I'd like to say that I am enourmously gratified at the willing effort so many people have put in to preserving this content, and, really, none of that effort is wasted. Redundancy is crucial in such a fluid community and just *trying* to help really shows what a great heart you people have.

I'd also like to specifically point out the *huge* effort Michael darkangel has made - all while continuing to update and bug-fix the TileSet Creator and Nw(g)Max!

The next step (while continuing to harvest projects) is to tweak Meaglyn's metadata formatter to prep for migrating the projects into drupal.

After the projects are migrated, then I'll be really diving into all those suggestions by Bannor, et al ;-) That's when we'll work out the look and feel of the site.  

I promise, no disco balls.

(Edit: reference

This video, entitled the "Sweet Dreams Video Album," was originally broadcast on MTV and partly filmed at a night club called "Heaven" in London in May 1983. It features Annie and Dave with a relatively new band line-up... 

...Reportedly the video was released against Dave and Annie's wishes as they weren't pleased with the performance - Annie had been ill and the new band did not have enough rehearsal time.    

The video opens with a surreal scene involving a music agent (Norman Bacon) being confronted by a tall man (Stephen Calcutt) who looks like he is straight out of the Black Lodge in Twin Peaks. The video then segues into the "concert" at Heaven, featuring Annie and Dave in a very eighties environment - full of pulsating disco balls, laser beams, lots and lots of fat analogue synth sounds, and big bouffy frizzy hairstyles. Dave looks like he's in another world as usual and Annie looks striking in her two piece suit complete with garters.

because someone asked ;-)

<...to the eighties>
               
               

               

                     Modifié par Rolo Kipp, 20 octobre 2012 - 04:57 .
                     
                  

            

[Legacy_Bannor Bloodfist]

               Gawd, I knew there was a decade that I hated... you just had to remind me about Disco  didntcha?

/me smacks RoloKip around with a wet trout

Edit:  P.S.  Shamefully admitting I forgot to type this bit of the message.

THANK YOU to EVERYONE that has contributed to this project.  Even if no-one in the future ever recognizes your efforts, please know that they ARE appreciated, and will be even by the folks that don't say so, simply because things will be there, and easily found etc... no one ever wishes to thank folks for things that work correctly, we all tend to just "expect it" to work. 

So, again, Thank You, VERY MUCH for all your efforts.
               
               

               

                     Modifié par Bannor Bloodfist, 20 octobre 2012 - 06:51 .
                     
                  

            

[Legacy_Rolo Kipp]

               <wipes his face...>

Hey!
Hmmm...
*Just* what Cestus needs for the Fishmonger Cart. Thanks for the fish!

<...with his long ugly scarf>
               
               

               
            

[Legacy_Lightfoot8]

               Just to throw a possiable monky wrentch in the mix.  

If you have control of the site that you are planning on uploading all of this too.  Is it not possiable to just send the site the information of what needs to be uploaded from the vault and have it do the uploading.   In effect cutting out the middle man.   I am no web guru, But is seems like something like that could be done.  

basicly in the form that gives the option of "uploading a file" you give an option of uploading the file from the web.   It would cut the time needed in at least half. most likely  even more then that sine most people's upload speed is a lot less then there download speeds.
               
               

               
            

[Legacy_Bannor Bloodfist]

               Please re-read my post located 3 above this one.
               
               

               
            

[Legacy_Rolo Kipp]

               <directing...>

ACD's perl script is doing that now. Running it on the site, it's grabbing the files, screenshots and metadata for each project.

Then Meaglyn's script will extract and massage the metadata into xml format for importing into the drupal mysql db, which will re-link all those files & screenshots with the project.

Host pipeline is *much* faster than wireless at Starbucks! =P

<...traffic>
               
               

               
            

[Legacy_Bard Simpson]

               This. Is. Awesome. You guys rock! As Bannor said, you probably won't get all the thanks you deserve, but I want to express my gratitude right now. This is a great idea, a tremendous job, and of immeasurable value. Thank you very much!
               
               

               
            

[Legacy_KlatchainCoffee]

               What Bard Simpson  said. '>
               
               

               
            

[Legacy_Zwerkules]

               What the coffee that makes you knurd said. '>
               
               

               
            

[Legacy_Rolo Kipp]

               <feeling all warm and fuzzy...>

Feedback is *always* appreciated.

Unfortunately, I've hit a huge snag. "Unlimited storage" is limited by "Clients may not use GreenGeeks servers for file storage unrelated to the client's web site, storage Space is for active web site file pages only. "

I.e. I have 48 hours to remove all those files I've collected :-(
So, either I find someone willing to host the files, find a new host that will host the files or point back to the IGN server (which defeats the purpose of mirroring the Vault).

Don't really know what to do, other than flush what I've done.

And I think this means I'll be moving on from GG, as I don't much appreciate how they handled my <blunder?> oversight.

And it's raining. *sigh*

Gonna go write sumpin. <wanna snail, boss?>
Not right now, Bother.

<...despite this cold cruel world>
               
               

               
            

[Legacy_Bannor Bloodfist]

               why not link the stuff to your website on a "hidden" link?  Something that only you and/or some admin folks can get to?
               
               

               
            

[Legacy_Rolo Kipp]

               <staring in dismay...>

It's not the links that are the problem. It's finding a reliable place to store the 500GB+ files somewhere other than IGN. :-/

I could, and may (at least for now) continue with the site re-vamp using direct links to IGN for now, to be fixed later when I find a reliable, always online place to keep the files.

<...at the 10lbs of stuff he needs to fit in a 1lb bag>
               
               

               
            

[Legacy_OldTimeRadio]

               Well, that is a blow but this is just (as Heneusa said) "the first round".  I don't have any good suggestions about how to store quite that much information online, save something like a NWN-specific torrent tracker.  Or get a 3TB internal/external drive, get the data on there and work on cleaning it up until some kind of better solution is found.  Of course, regardless of their merits, neither of those options might be possible in a 48-hour window.

Most of the "solutions" I've focused on were really dire situations where these forums are gone, the Vault's gone, etc.  Ideas like shooting CC into Usenet.

But for something a little more realistic, I wonder about the viability of Google Data hosting.  It really depends on just how much data is being talked about.  Reminds me of working with CC: So many little gears that all need to mesh properly to get something to come out right.
               
               

               
            

[Legacy_Rolo Kipp]

               <meshes...>

Hmmm, Google or perhaps Sourceforge? I'll look into those.
Grabbing the stuff with ACD's scripts works fine, and I will continue to whittle away at them here, over my little Starbucks connection (I have a terabyte external just for the Vault stuff). It's making those files available online that is stumping me.

<...and gnashes his teeth>
               
               

               
            

[Legacy_Bannor Bloodfist]

               What I mean Rolo, was placing the files/links, all of it, AS part of your website, only with limited access control, IE, private group of users/admins whatever, so that your Host can't complain about the files being stored there.

@OTR, I think the issue now, at this stage, is finding a way to download then re-upload 500GB of files.  Most of us have limited (relative term I know) transfer speeds.  It has taken Days for Rolo to have his server grabbing stuff without it going down the road to his local PC.  That down to local instance and back up is where the main issue is, that and having only 48 hours to "solve" the space usage issue.

@Rolo... I have had the same sort of issue with other webhosting sites, sometimes if you can get a human on the phone, you can resolve it, usually though, they all claim "unlimited" but all actually mean "unlimited in your imagination, once you use it, we delete it!"
               
               

               

                     Modifié par Bannor Bloodfist, 22 octobre 2012 - 06:26 .