Sql Backup And FTP

Welcome Guest Search | Active Topics | Log In | Register
New Topic Post Reply
slow Backup process Options · View
kalo
#1 Posted : Tuesday, July 24, 2012 11:24:18 AM Quote
Rank: Newbie

Groups: Registered

Joined: 7/24/2012
Posts: 4
Hello,

Our company was really excited of purchasing MySql backup manager and we had really good first impression.
However, after a week of use, we noticed that the all process running really slow. The issue could be in our server, not in the software, but i would like to explain and ask for advice.

Our current configuration is Dell R810 (pretty good server) with 48GB RAM
dBase size is 165GB. We had scheduled a windows task via control panel- daily from 1.30AM

First thing we noticed that MySql backup actually creted 2 copy of the dbase. Why? I will try to add a screenshot.
For the actual 2 copies on the dBase takes around 12 hours. It takes additional 8 hours to compressed the the file.
On the bottom line, the all process took about 20-21 hours. Our old MySql backup manager used to finished the sane job for about 6-7 hours.

Considering the size of our dBase, is that a projecting speed to take a backup or there something that need to be adjusted?

Please, get back to us as soon as you can and advie.

File Attachment(s):
photo.jpg (982kb) downloaded 3 time(s).
AlexS
#2 Posted : Wednesday, July 25, 2012 4:34:07 AM Quote
Rank: Administration

Groups: Administrators, Registered

Joined: 7/12/2012
Posts: 106
Hi,

Two copies of the files is a normal. One of them have to be deleted when backup complete.

What connection type do you using(TCP/IP or phpMyAdmin)?

If your destanation is FTP, please, enable option FTP Settings ->Advanced FTP Settings -> "Write FTP session to log" and send log to us.
Guest
#3 Posted : Wednesday, July 25, 2012 2:59:54 PM Quote
Rank: Guest

Groups:

Joined: 8/10/2009
Posts: 947
We are using TCP/IP connection
Server - Dell R810

Backup dbase size 165GB

It create 2 copies and delete both after the compression

We are backing up Netgear NASready (ReadyNAS Duo) which is a iSCSI device connected over the server via gigabit switch and mounted as a local drive with Microsoft iSCSI initiator software.

We have a windows scheduled task for 1.30AM everyday. Its took approximately 22 hours, which is not normal.

Please, advise
kalo
#4 Posted : Thursday, July 26, 2012 4:36:38 PM Quote
Rank: Newbie

Groups: Registered

Joined: 7/24/2012
Posts: 4
We are using TCP/IP connection
Server - Dell R810

Backup dbase size 165GB

It create 2 copies and delete both after the compression

We are backing up Netgear NASready (ReadyNAS Duo) which is a iSCSI device connected over the server via gigabit switch and mounted as a local drive with Microsoft iSCSI initiator software.

We have a windows scheduled task for 1.30AM everyday. Its took approximately 22 hours, which is not normal.

Please, advise



Any UPDATE ?

Thank you,
AlexS
#5 Posted : Thursday, July 26, 2012 10:48:20 PM Quote
Rank: Administration

Groups: Administrators, Registered

Joined: 7/12/2012
Posts: 106
In case of TCP/IP connection application uses mysqldump (depends on your MySql server version) utility http://dev.mysql.com/doc/refman/5.1/en/mysqldump.html to create the database backup.

Can you please check how long mysqldump doing the backup on your system if you run it from command line.
We need to understand where is the 'bottleneck'.
kalo
#6 Posted : Friday, July 27, 2012 11:47:11 AM Quote
Rank: Newbie

Groups: Registered

Joined: 7/24/2012
Posts: 4
>>> run 7/27/2012 1:33:15 AM by SYSTEM

MySqlBF 1.4.7.19883 Lifetime at EMR-SVR (Microsoft Windows NT 5.2.3790 Service Pack 2)

SUMMARY:
Database mobiledoc: Backup - Success

DETAILED LOG:
7/26/2012 1:40:01 AM Creating backup of mobiledoc to K:\eClinicalWorks\Temp
7/26/2012 1:56:10 PM Backup of mobiledoc completed
7/26/2012 1:56:10 PM Compressing (7-zip 7z) K:\eClinicalWorks\Temp\mobiledoc201207260140.sql to K:\eClinicalWorks\backup\mobiledoc201207260140.7z
7/27/2012 1:33:09 AM Compression completed (archive size: 3,729,026 KB)
7/27/2012 1:33:09 AM Removing mobiledoc201207260140.sql from K:\eClinicalWorks\Temp
7/27/2012 1:33:10 AM Cleaning K:\eClinicalWorks\backup
7/27/2012 1:33:15 AM Job finished

Here us a log file.

Can you please explain how to check "how long mysqldump doing the backup on your system if you run it from command line"

Thank you,
AlexS
#7 Posted : Friday, July 27, 2012 12:46:07 PM Quote
Rank: Administration

Groups: Administrators, Registered

Joined: 7/12/2012
Posts: 106
Thank you for the log provided.

mysqldump.exe can be found in your MySql server installation. Find it and put to your client machine.
According the documentation http://dev.mysql.com/doc/refman/5.1/en/mysqldump.html you can run the command below in cmd.exe.
Just replace params {value} with your real values.

mysqldump.exe --host="{Hostname}" --user="{Username}" --password="{Password}" {dbname} > "c:\tmp_backup.sql"

Application can't do the backup with the speed higher than this tool, since using it internally.
By this way we can get the average time required tool to create backup on your host.

Then try to archive "c:\tmp_backup.sql" with 7-zip tool manually with standart setting.
By this way we can get the average time required to compress the backup file.

Application using this tools internally to do the job, so may be your database became really huge already.
kalo
#8 Posted : Monday, July 30, 2012 11:13:26 AM Quote
Rank: Newbie

Groups: Registered

Joined: 7/24/2012
Posts: 4
Hello AlexS,

I have requested mySQL dump. We do not have a user name and password to the dbase since contain patient demographics data. We should have the results shortly.

However, the mysql dump will help to determinate a speed to make a copy of the dbase. Other issue, which i mention already is that we have experience 8-9 hours for compressing process. I have try to compress to .zip (x64) and .7z, but the time was the same. It took average of 8.5 hours to compress 165GB dbase. CPU - E5530, RAM - 32GB

Please advise,
AlexS
#9 Posted : Monday, July 30, 2012 11:46:35 AM Quote
Rank: Administration

Groups: Administrators, Registered

Joined: 7/12/2012
Posts: 106
Looks like the 8-9 hours for a 165GB file compressing - is an average time and we can decrease it just by set a lower compression level in a setting.
But I'm not sure that the difference will be huge.
Quick Reply Show Quick Reply
New Topic Post Reply
Forum Jump  
You can post new topics in this forum.
You can reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You can create polls in this forum.
You can vote in polls in this forum.

©Pranas.NET MySql Backup MySql Backup to cloud Free SQl Backup SQL Backup Master Employee monitoring software Web Scraping Azure SQL Database Backups