FTP dont work!

[RaymondParticipant]

Because SCP is not working all the way I wanted to test FTP on my WD My Book Live.

I can FTP with it in Google Chrome like this:

ftp://192.168.2.51/

I can all so ftp to it with WinSCP.

But when I click test in Updraftplus it can’t connect.

I even put in it’s FTP Server 192.168.2.51:21

Still not good. With the port number or with out it.

I guess if that works then SCP would work.

When I click test it comes back with “Failure: we did not successfully log in with those credentials.” I sued the same with Chrome and WinSCP and they both worked.

-Raymond Day

[RaymondParticipant]

Got it working I had to click on:

Do not verify SSL certificates:

and this.

Disable SSL entirely where possible:

Not sure if I had to click both of them but it works. Not to test it again.

-Raymond Day

[RaymondParticipant]

The FTP got done. But looks like it did not save all the files to the zip.

I open the zip with WinRAR and it only shows Year folders of:

2007
2008
2013

But I have:

1978
2006
2007
2008
2009
2010
2011
2012
2013

I thought the upload.zip was to small. So I open it. It don’t have the fill upload folder.

-Raymond Day

[RaymondParticipant]

I did a command to test how big it would zip up the upload folder. I did it like this:

zip -r /media/USBdisk2-3TB/usr/share/wordpress/wp-content/updraft/12-25-2013_uploads.zip /media/USBdisk2-3TB/usr/share/wordpress/wp-content/uploads

Then I open the 12-25-2013_uploads.zip file and it shows every thing not like Updraftplus show the upload folder.

The size went to 7.17 GB zipped up the uploads folder. I can get to it with samba. Go any were on my server like that. So can see it in Windows good.

I don’t get why Updraftplus does not zip up the hole /media/USBdisk2-3TB/usr/share/wordpress/wp-content/uploads folder because I just made sure it will by doing it by hand on the command line.

What could be wrong?

-Raymond Day

[udadminKeymaster]

Hi Raymond,

> I thought the upload.zip was to small. So I open it. It don’t have the fill upload folder.

If your uploads is 7.5Gb, then there will be more than one upload zip. If you had a file ending in uploads.zip, then there should also be uploads2.zip, uploads3.zip, etc. UD splits them (by default every 800Mb) because manipulating multi-gigabyte zip files is incredibly slow except on blazing fast servers.

Also: please always post the log file so that I get the full picture. Then I can be more sure about the likely problem.

Best wishes,
David

[RaymondParticipant]

Comcast gives some free server space. So I ftp the log file there.

You can see it here

I did another backup at the start of today I clicked backup and it gets done soon on a LAN drive.

I had the Split archives every: to something like 20048 Mb. But for this backup I put it to 2048 Mb this time it did make a:

backup_2013-12-27-0421_my_weblog_1eac399a0ede-uploads.zip
backup_2013-12-27-0421_my_weblog_1eac399a0ede-uploads2.zip

1.99 GB For uploads.zip and 871 MB for the uploads2.zip

But it still don’t look like it got it all. When I click on count it says

Quote:

Uploads:7.3 Gb count

But it’s not saving all that.

The zip file I did by command line to test it on the uploads folder went to 7.17 GB in size. One zip file.

That’s why I set the Split archives every to a long one. I wanted it to just do one big zip file.

-Raymond Day

[udadminKeymaster]

Hi Ray,

Does your operating system support files that large? Many operating systems support single files only up to 2Gb in size. So a zip file can’t go larger than 2Gb. The limit in UD is only approximate (because it’s not possible to predict in advance how much a file will be compressed). I’d guess that’s the problem you’re having – you need to choose something small than 2Gb (e.g. 1.5Gb).

Best wishes,
David

[RaymondParticipant]

It can take way over 2Gb in size. Any server or Computer I have here can. Flash drives and things. Lots of HD videos are over 2Gb.

Just to make for sure I am copying the zip backup I did on the command line of my uploads folder to my WD Mybook live right now.

I got a screen of it here.

It’s all most done as I type this. I will wait to make sure.

It worked. So for sure it can save this one big zip file of my uploads folder to a 1TB WD my book live.

Any way it’s on my server I use WordPress on any way. This server has two 3TB WD hard drives on it. Both green type. It’s running on a HDMI stick. At UG802 Blue color.

Here is the CPU info:

Code:

root@small3:~# cat /proc/cpuinfo
Processor : ARMv7 Processor rev 0 (v7l)
processor : 0
BogoMIPS : 503.83

processor : 1
BogoMIPS : 503.83

Features : swp half thumb fastmult vfp edsp neon vfpv3
CPU implementer : 0x41
CPU architecture: 7
CPU variant : 0x3
CPU part : 0xc09
CPU revision : 0

Hardware : RK30board
Revision : 0000
Serial : 0000000000000000
root@small3:~#

It has 1GB RAM.

Soon I will have this running on a Odroid-XU here is it’s CPU info.

Code:

root@odroid:~# cat /proc/cpuinfo
Processor : ARMv7 Processor rev 2 (v7l)
processor : 0
BogoMIPS : 1785.85

processor : 1
BogoMIPS : 1785.85

processor : 2
BogoMIPS : 1785.85

processor : 3
BogoMIPS : 1785.85

Features : swp half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt
CPU implementer : 0x41
CPU architecture: 7
CPU variant : 0x0
CPU part : 0xc07
CPU revision : 2

Hardware : ODROIDXU
Revision : 0000
Serial : 0000000000000000
Board Type : XU
root@odroid:~#

This one has 2GB of RAM.

How can I get updraftplus to upload one zip file of the uploads folder?

I have a lot of True Image backups and they are super big files in size.

-Raymond Day

[udadminKeymaster]

Hi Raymond,

It’s very unlikely to be possible. When you create a 7.5Gb zip at the command line, it is done in one operation. But a WordPress backup plugin can’t do that, because it’s expecting the webserver to only allow it a limited number of seconds. So, it has to work in batches. The zip file format isn’t great for working in batches; to update an *existing* zip file (instead of creating a brand new one), you have to copy the zip file, amend it, and then over-write the existing one. That’s really, really slow once you’re getting into the multi-gigabyte range. So, at the command line there’s a single 7.5Gb write operation… but when done via PHP/WordPress, it would involve copying a growing 1 Gb, 2Gb, 3Gb, etc., zip file many times over – nightmare!

Best wishes,
David

[RaymondParticipant]

So what should I do to fix this? Keep setting the splits to every 800Mb and then lower till it works?

It’s just not saving the hole upload folder.

I been near my 1TB WD mybook live for a wile wile WordPress is backing up. All ready it’s come out of sleep mode 3 times in the last hour. I guess that’s how much time it take between the saves. But like you said the best you can do in a webserver commands.

Just checked the backup files. It’s still doing the same Uploads.zip and uploads2.zip the 1ST one is 1.99GB and the 2ND one is 864 MB it never saves a 3RD one.

-Raymond Day

[udadminKeymaster]

Hi Raymond,

Things will certainly run better if you reduce the split limit. I’m not familiar with the ARMv7, but basically, it’s disk I/O that there’s going to be a lot of. The smaller you make the split limit, the less disk I/O you’ll get.

The most resource-efficient way to take a backup is to do it from cron/shell:
https://updraftplus.com/faqs/can-i-run-backups-from-the-shell/

*However* – we are planning on adding a new feature to UD that will create backups as tar.gz files. These don’t have the issues that zip files have with needing to copy/modify/re-copy them when adding new files to them. Tar files are just chained. So, this will make things a lot faster for situations like yours. Keep watching our blog for when it’s announced!

Best wishes,
David

[Author]

Posts