AWS - The Core Storage Services #8

AWS - The Core Storage Services #8

1. Domain 2: Security and Compliance

   • 2.2 Understand AWS Cloud security, governance, and compliance concepts
   • 2.3 Identify AWS access management capabilities

2. Domain 3: Cloud Technology and Services

   • 3.1 Define methods of deploying and operating in the AWS Cloud
   • 3.3 Identify AWS compute services
   • 3.4 Identify AWS database services
   • 3.5 Identify AWS network services
   • 3.6 Identify AWS storage services
   • 3.8 Identify services from other in-scope AWS service categorie

3. Simple Storage Service (S3)

   • S3 charges you a monthly storage cost based on the amount of data you store and the storage class you use.
   • S3 offers six different storage classes at different price points.
   • You're not charged for uploading data to S3, but you may be charged when you download data

4. S3 Glacier

5. AWS Storage Gateway

6. AWS Snow Family

7. Storage Classes for Frequently Accessed Objects

   • STANDARD
     • This is the default storage class. It offers the highest levels of durability and availability, and your objects are always replicated across at least three availability zones in a region.
   • REDUCED_REDUNDANCY
     • The REDUCED_REDUNDANCY (RRS) storage class is meant for data that can be easily replaced, if it needs to be replaced at all. It has the lowest durability of all the classes, but it has the same availability as STANDARD. AWS recommends against using this storage class but keeps it available for people who have processes that still depend on it. If you see anyone using it, do them a favor and tell them to move to a storage class with higher durability!

8. Storage Classes for Infrequently Accessed Objects

   • Two of the storage classes designed for infrequently accessed objects are suffixed with the “IA” initialism for “infrequent access.” These IA classes offer millisecond-latency access and high durability but the lowest availability of all the classes. They're designed for objects that are at least 128 KB in size. You can store smaller objects, but each will be billed as if it were 128 KB:
   • STANDARD_IA
   • ONEZONE_IA
   • GLACIER
   • GLACIER_IR
   • DEEP_ARCHIVE

9. Storage Class for Both Frequently and Infrequently Accessed Objects

   • INTELLIGENT_TIERING

10. Access Permission

    • S3 is storage for the Internet, but that doesn't mean everyone on the Internet can read your data. By default, objects you put in S3 are inaccessible to anyone outside of your AWS account. S3 offers the following three methods of controlling who may read, write, or delete objects stored in your S3 buckets:
    • Bucket policies
    • User policies
    • Bucket and object access control lists

11. Encryption

    • S3 doesn't change the contents of an object when you upload it. That means if you upload a document containing personal information, that document is stored unencrypted. Using appropriate access permissions can protect your data from unauthorized access, but to add an additional layer of security, you have the option of encrypting objects before storing them in S3. This is called encryption at rest. S3 gives you the following two options for encrypting objects at rest:
    • Server-side encryption
    • Client-side encryption

12. Versioning

    • To further protect against accidentally deleting or overwriting the contents of your important files, you can use versioning. To understand how versioning works, consider this example. Without versioning, if you upload an object with the same name as an existing object in the same bucket, the contents of the original object will get overwritten.
    • To further protect against accidentally deleting or overwriting the contents of your important files
      • If you delete an object in a bucket on which versioning is disabled, the contents of the object aren't deleted. Instead, S3 adds a delete marker to the object and hides it from the S3 service console view.

13. Object Life-Cycle Configurations

    • Transition Actions
      • Transition actions move objects to a different storage class once they've reached a certain age. For example, you can create a rule to move objects from the STANDARD storage class to the STANDARD_IA storage class 90 days after creation.
    • Expiration Actions
      • These can automatically delete objects after they reach a certain age. For example, you can create a rule to delete an object older than 365 days. If you have versioning enabled on a bucket, you can create expiration actions to delete object versions of a certain age. This allows you to take advantage of versioning without having to store endless versions of an object.

14. S3 Glacier

    • S3 Glacier offers long-term archiving of infrequently accessed data at an incredibly low cost
    • Glacier guarantees 99.999999999 percent durability over a given year
    • Because Glacier is designed for long-term archiving, it doesn't provide real-time access to archives
      • The length of time it takes to complete a job depends on the retrieval option you choose. There are three retrieval options:
        • Expedited
          • Except during times of unusually high demand, expedited retrievals usually complete within 1 to 5 minutes, although archives larger than 250 MB may take longer
        • Standard
          • Standard retrievals typically complete within 3 to 5 hours for S3 Glacier Flexible Retrieval, or 9–12 hours for S3 Glacier Deep Archive
        • Bulk
          • Bulk retrievals are the lowest-cost option, at $0.0025 per gigabyte in the US East region, and they typically complete within 5 to 12 hours for S3 Glacier Flexible Retrieval, and within 48 hours for S3 Glacier Deep Archive.

15. AWS Storage Gateway

    • AWS Storage Gateway makes it easy to connect your existing on-premises servers to storage in the AWS cloud
    • Volume Gateways
      • Volume gateways offer S3-backed storage volumes that your on-premises servers can use via the Internet Small Computer System Interface (iSCSI) protocol.
    • File Gateways
      • A file gateway lets you use the Network File System (NFS) and Server Message Block (SMB) protocols to store data in Amazon S3.

16. AWS Snow Family

    • AWS will ship you a physical device to which you transfer your data. When you're ready, you can then send the device back to Amazon
      • Amazon will then transfer your data to buckets on S3.
    • AWS Transfer Family
      • AWS Transfer Family lets you transfer data into and out of S3 and EFS using three time-tested, familiar protocols: File Transfer Protocol (FTP)Secure Shell (SSH) File Transfer Protocol (SFTP)File Transfer Protocol over SSL (FTPS)
      • Amazon FSx
        • Amazon FSx allows you to store and retrieve files in the AWS cloud using common, industry-standard file sharing protocols. Amazon FSx comes in four flavors: FSx for Lustre, FSx for Windows File Server, FSx for OpenZFS, and FSx for NetApp ONTAP. Lustre is an open source distributed filesystem built to give Linux clusters access to high-performance filesystems for use in compute-intensive operations. As with Lustre, Amazon's FSx service brings OpenZFS and NetApp filesystem capabilities to your AWS infrastructure. FSx for Windows File Server, as you can tell from the name, offers the kind of file-sharing service EFS provides but for Windows servers rather than Linux. FSx for Windows File Server integrates operations with Server Message Block (SMB), NTFS, and Microsoft Active Directory.
        • AWS Elastic Disaster Recovery
          • AWS Elastic Disaster Recovery Service (AWS Elastic DRS) enables point-in-time recovery of your cloud-based applications. You install the AWS replication agent on the servers you want to back up (the source servers), and DRS goes to work automatically backing up everything on the server. Source servers can be on-premises physical machines, virtual machines, or cloud-based EC2 instances.

17. Snowball

    • AWS Snowball is a hardware appliance designed to move massive amounts of data between your site and the AWS cloud in a short time.
    • Snowball Edge
      • Snowball Edge is like Snowball but offers a wider variety of features. Snowball Edge offers the same network connectivity options as Snowball but adds a QSFP+ port, allowing you to achieve faster network speeds than Snowball. Also, Snowball is designed to transfer large amounts of data only between your local environment and S3
    • Snowmobile
      • AWS Snowmobile is a 45-foot-long waterproof and tamper-resistant shipping container meant for petabyte or exabyte data migrations. The idea is that, like Snowball, you connect the parked container to your local network to transfer your data. When you're done, AWS will drive the container to an AWS region and upload your data.

18. difference between durability and availability in S3

    • Durability is the likelihood that an object won't be lost over the course of a year
    • Availability is the percentage of time an object will be accessible during the year.

19. differences between S3 and Glacier

    • S3 offers highly available, real-time retrieval of objects. Retrieving data from Glacier is a two-step process that requires first requesting an archive using the Expedited, Standard, or Bulk retrieval option and then downloading the archive once the retrieval is complete.

20. use encryption, versioning, and object life-cycle configurations in S3

    • S3 offers server-side and client-side encryption to protect objects at rest from unauthorized access
    • Versioning helps protect against object overwrites and deletions
    • Object life-cycle configurations let you delete objects or move them to different storage classes after they reach a certain age.