×
INTELLIGENT WORK FORUMS
FOR ENGINEERING PROFESSIONALS

Log In

Come Join Us!

Are you an
Engineering professional?
Join Eng-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Eng-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Jobs

Efficient Data back-ups
2

Efficient Data back-ups

Efficient Data back-ups

(OP)
Hello All,

This is my first post on the computer forum.  I would like some data back-up advice.  

I work in two locations (lets call them L1 and L2).  I would like to keep my main base for the data files at L1.  However, whilst I am working at L1 at the end of the day I would like to take the latest data with me without quickly (without having to wait ages to copy the files to a external harddrive).  Then after updating the data at L2, I would like to update the data at L1.  I will have at least 50-60GB of data soon.  I hope this makes sense?

Any advice on this, with options and ideal solutions?

Thanks

OptiEng

RE: Efficient Data back-ups

I use Goodsync, which allows you to set periodic updates throughout the day, so that the COB sync would only be of the files that you worked on in the last half hour or hour.  Your description sounds a little hazy, so I'm not sure if Goodsync is appropos.

TTFN

FAQ731-376: Eng-Tips.com Forum Policies

RE: Efficient Data back-ups

I think that's one of a multitude of things that rsync is supposed to be able to do.  

{I personally have never been able to get rsync to do _exactly_ what I thought it was going to do, but that may well be pilot error.  There are many options, and the man pages are written in geeklish.}

 

Mike Halloran
Pembroke Pines, FL, USA

RE: Efficient Data back-ups

(OP)
Thanks for your responses, sorry if the description did not make sense.  Basically I would like to keep my files updated (at least daily) in two locations, as efficiently as possible.  Thanks for your advice.

RE: Efficient Data back-ups

How are the locations related, i.e., are they on the same network?  What's the transport mechanism for actually moving files between L1 and L2?

TTFN

FAQ731-376: Eng-Tips.com Forum Policies

RE: Efficient Data back-ups

(OP)
IRstuff, no they are not on the same network, but I do have remote access to L1 from L2.  At the moment I am just using a USB stick and transferring all the files every time I leave the office, which takes ages.  When I get to L2 I just delete all my delete all my files and upload the latest data from the usb stick.

You would probably think I could just transfer the things that have changed.  But I change things I lots of folders and keeping a track of that would be tricky.

Thanks for you input everyone

RE: Efficient Data back-ups

OK like I said, something like GoodSync can run the background throughout the day, and update files as necessary on your stick.  The program only updates files that have changed, so you're only copying whatever you've actually touched during the day.

When you get to L2, the program can then hunt down the differences and update L2 with the changed files.  

Note that the program will transfer two-ways, so any file on L2 that has been updated would cause the program to update the stick with the changed file, and the next time you get back to L1, the program will then update the corresponding file on L1.  

While I use GoodSync, the built-in "Briefcase" functionality in Windows will supposedly do the about same thing.  I've had problems with Briefcase, but it does work.  I can't quite remember if it does periodic updates; I vaguely recall that it needed to be manually commanded to update.

GoodSync has a demo that you can download to test it out: http://www.goodsync.com/freevpro.html

TTFN

FAQ731-376: Eng-Tips.com Forum Policies

RE: Efficient Data back-ups

I use a batch file to run robocopy.  It has a good range of options and should only copy newer or changed files.  

Like the others said, if you setup a batch file to run about an hour before you leave, then it won't take so long at the end of the day.  

Of course, if you really are *changing* 50gb of data per day, then you are still at the mercy of the speed of the USB stick when you get to L2.  

I haven't had any personal experience with it, but isn't eSATA supposed to be fairly fast?  Might be something to look into (but could require new hardware at both locations)

RE: Efficient Data back-ups

There's no need to manually do anything with GoodSync, once you've set up the jobs.  I've got a 25 minute cycle during the day that updates as I work.  The jobs are configured to do a final update when my laptop is shutdown for the evening, and will keep the laptop running until all the updates are completed.  Likewise, when the program is started up the next day, it runs update automatically.

It's probably a couple of minutes extra for about 10 different folders that I synchronize.

TTFN

FAQ731-376: Eng-Tips.com Forum Policies

RE: Efficient Data back-ups

(OP)
Hello all,

Thanks for your help and advice. Is there any freeware software that can do a similar job to GoodSync?  

What happens if you have a file open and Goodsync tries to make a backup of it?

Thanks again.

OptiEng

RE: Efficient Data back-ups

As Mike Halloran pointed out above, rsync.  It is free, open source, secure, reliable, has a long time history, and can work over a wide variety of network configurations.  

 

RE: Efficient Data back-ups

(OP)
Hi ajack1,

Thanks for your input, you suggestion is good.  However, I already have remote access, but this only allows me "access" to the files.  I would need to electronically transfer this file from the computer I am accessing remotely to the computer I am working from.

For exmaple if I am working on graphics, this seems to run very slowly when through "remote access".

Thanks

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Eng-Tips Forums free from inappropriate posts.
The Eng-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Eng-Tips forums is a member-only feature.

Click Here to join Eng-Tips and talk with other members!


Resources