Home Latest News AWS DataSync Supports Moving Data between AWS, Google Cloud and Azure –...

AWS DataSync Supports Moving Data between AWS, Google Cloud and Azure – InfoQ.com


Attend QCon San Francisco (Oct 24-28) and find practical inspiration from software leaders. Register
Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Avdi Grimm describes the future of development, which is already here. Get a tour of a devcontainer, and contrast it with a deployment container.
Kin Lane discusses API specifications like OpenAPI and AsyncAPI, and how they have emerged as the way API producers and consumers are engaging across the entire API lifecycle.
The panelists discuss lessons learned with putting ML systems into production, what is working and what is not working, building ML teams, dealing with large datasets, governance and ethics/privacy.
In this podcast Shane Hastie spoke to Joshua Kerievsky about his keynote at the Agile 2022 conference in July and his forthcoming book Joy of Agility
A thorough implementation of policy management tools is required for effective compliance and security management in a DevOps environment. Companies that accept policy management in DevSecOps as a way of development and have adopted some level of policy management best practices tend to operate more efficiently.
Learn how cloud architectures achieve cost savings, improve reliability & deliver value. Register Now.
Learn how to migrate an application to serverless and what are the common mistakes to avoid. Register Now.
Understand the emerging software trends you should pay attention to. Attend in-person on Oct 24-28, 2022.
InfoQ Homepage News AWS DataSync Supports Moving Data between AWS, Google Cloud and Azure
Jun 05, 2022 2 min read
Renato Losio
Amazon recently announced that AWS DataSync now supports Google Cloud Storage and Azure Files storage as storage locations. The two new options of the data service helps moving data both into and out of AWS, but data transfer fees still might still be a limitation.
DataSync can copy and synchronise data across different storage locations and move it to AWS, supporting multi-cloud workflows or data retention requirements. Relying on a proprietary network protocol, DataSync runs and verifies one-time and periodic data transfers and scales according to the size of the job. The service provides include/exclude filters, bandwidth throttling controls and supports automatic recoveries from temporary network issues. Danilo Poccia, chief evangelist EMEA at AWS, explains:
In this way, you can simplify your data processing or storage consolidation tasks. This also helps if you need to import, share, and exchange data with customers, vendors, or partners who use Google Cloud Storage or Microsoft Azure Files. DataSync provides end-to-end security, including encryption and integrity validation.
Google Cloud Storage and Azure Files storage are the first sources targeted to competitor services but they are not the only storage locations supported: AWS DataSync can synchronise data with NFS, SMB, Hadoop Distributed File Systems (HDFS), self-managed object storage and different AWS services for example Amazon S3 or Amazon FSx.
1DataSync Azure2AWS 1654261190159
Source: https://aws.amazon.com/blogs/storage/how-to-move-data-from-azure-files-smb-shares-to-aws-using-aws-datasync/
While Poccia explains how to move data from Google Cloud Storage to Amazon S3, Rodney Underkoffler and Aidan Keane, senior specialist solutions architects at AWS, show how to move data from Azure Files SMB shares. In the past the cloud provider explained how to transfer data between AWS accounts using DataSync. Corey Quinn in his newsletter writes:
This might be one of the most impressive AWS features I've seen in a while. It acknowledges both the existence of other clouds as well as the fact that customers might want data to live there sometimes. Well done.
Larry Hau, director of product at Rackspace Technology, agrees:
This seems like a huge deal (…) AWS has always locked customers in and this reverses that. Egress is still a barrier but this makes data migration much easier especially for BCP/DR.
AWS DataSync might help migrating data across the major cloud providers but data transfer fees can be a significant barrier. To mitigate the impact and reduce egress fees, AWS recommends deploying the DataSync agent in the source environment as it compresses data in flight when copying.
There are no specific DataSync costs for the new storage options but moving data to AWS, customers are subject to data transfer fees on Google Cloud and Microsoft Azure. Moving data from AWS, customers are charged for data transfer out from EC2 to the internet.
The rate at which AWS DataSync copies depends on the amount of data and network conditions. For example, for data transfer between on premises and AWS, a task can fully use a 10 Gbps network link.

Becoming an editor for InfoQ was one of the best decisions of my career. It has challenged me and helped me grow in so many ways. We’d love to have more people join our team.

Join us at Microsoft JDConf 2022, a virtual Java conference for developers (May 4/5) – Save Your Seat.
A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. View an example


We protect your privacy.
You need to Register an InfoQ account or or login to post comments. But there’s so much more behind being registered.
Get the most out of the InfoQ experience.
Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. View an example

We protect your privacy.
Real-world technical talks. No product pitches.
Practical ideas to inspire you and your team.
QCon San Francisco – Oct 24-28, In-person.

QCon San Francisco brings together the world’s most innovative senior software engineers across multiple domains to share their real-world implementation of emerging trends and practices.
Uncover emerging software trends and practices to solve your complex engineering challenges, without the product pitches.Save your spot now
InfoQ.com and all content copyright © 2006-2022 C4Media Inc. InfoQ.com hosted at Contegix, the best ISP we’ve ever worked with.
Privacy Notice, Terms And Conditions, Cookie Policy


Previous articleWill FIREPIN Token (FRPN) Attract a Huge Following Like Dogecoin (DOGE) and Shiba Inu (SHIB)? – The Portugal News
Next articleDogecoin price prediction: Is the slide a shorting opportunity? – Capital.com
She has been writing columns on consumer gadgets for over 2 years now. Her areas of interest include smartphones, tablets, mobile operating systems and apps. She holds an M.C.S. degree from Texas A&M University.