Podchaser Logo
Home
780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

Released Monday, 10th June 2024
 1 person rated this episode
780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

780: Cloud Storage: Bandwidth, Storage and BIG ZIPS

Monday, 10th June 2024
 1 person rated this episode
Rate Episode

Episode Transcript

Transcripts are displayed as originally observed. Some content, including advertisements may have changed.

Use Ctrl + F to search

4:00

I just feel like the era of,

4:02

oh man, your LaCie drive

4:04

has all of a sudden stopped working

4:06

and your backup is toast is over,

4:08

but that doesn't mean that. You

4:10

shouldn't be. It's not, literally last

4:13

night on TikTok, I saw this

4:15

photographer and maybe in

4:17

the developer community this is a thing of the

4:19

past, but my sister's photographer, I

4:21

talked to so many of them, they have dozens

4:24

of these little LaCie drives all

4:27

around their house. They're probably moving around the

4:30

line. At least once a year,

4:32

a year and a half, I get a panic message

4:34

from a friend of a friend. My

4:37

hard drive's clicking and I can't turn it on

4:39

and it has wedding photos from this couple, like

4:41

please, especially if it's

4:43

like a little thing that is so easily

4:45

dropped. This is not the backup show. Well, maybe we'll

4:47

do that again, that show as well, but man,

4:52

what else do we put there? I put the original recordings on.

4:54

So when I'm recording

4:56

a course or this podcast, the raw

4:58

files can be very, very large. And

5:01

sometimes you want to keep those raw

5:03

files. So it's nice to have

5:05

a spot to put those. I put caption files on

5:07

there so I can download them and put them into

5:09

my course player. These big

5:11

zips for all of my courses is

5:14

another one that I do. So like

5:16

99% of people stream the course, right? You

5:18

get a nice experience. You get the notes

5:20

along with it. You track

5:22

your progress, but some people just want the

5:25

MP4 files so they can download it and watch

5:28

it locally. So in

5:30

order to allow that, I

5:33

throw them up on one of these

5:35

cloud providers and allow them to download it.

5:37

Older code bases, I have like basically like

5:41

15 years of web development of old websites

5:43

that I've built. And like, I

5:45

don't delete them. I just put them up.

5:47

You can put them on GitHub as well, but I just drag

5:50

and drop, put the whole sucker up on a cloud

5:53

provider. And then I've been recently,

5:55

this is why I got into this is I've

5:57

been trying to find a solution for.

8:00

I'm pooched. Yeah, you're right. Yeah, you're right. You're

8:02

right. And I did lose a 200 gigabyte lacy

8:05

hard drive back in the day And

8:07

I lost most of my video projects

8:09

that I made when I was at early college, which

8:12

is fine. So there you go So

8:16

let's talk about some things that we're not

8:18

talking about really quickly is Your

8:21

your server and like why would you

8:23

want larger storage? So usually when you

8:25

host your application you get

8:27

a server and That

8:29

server will have space that you can upload

8:32

files to that will run your application, right?

8:34

And there are often limited in terms of

8:36

both how much space you're allowed to

8:39

upload things to so they'll give you 20

8:42

gigs or 10 gigs something like that

8:44

You can upload your whole application there and

8:46

often you can put files and images

8:49

on there if you want but the

8:51

bandwidth for those things are very expensive

8:53

because The people who supply

8:55

you with compute are not

8:57

necessarily the same people that supply you

8:59

with like large amount of storage and

9:02

Bandwidth often people will just stick

9:04

a CDN in front of those files that

9:06

are on the same server. That's a really

9:08

good solution This is not a show about

9:10

CDNs not a show about image compression video

9:12

streaming things like that because that's

9:15

a whole nother level and often

9:18

those services that are image

9:20

resizing compression CDN distribution

9:22

around the world those things sit on

9:24

top of Just

9:26

your raw hosted Object

9:29

structure, which is what we're talking about

9:31

today, which is basically just a place

9:33

to put big files big

9:35

zips Yeah, and it's

9:38

it's largely because these things really

9:40

specialize in holding a lot of

9:42

data Not necessarily distributing

9:44

that data that's not there, you

9:47

know their primary task Exactly.

9:49

So big players in this space are

9:51

the bit like I think the big

9:53

first one was Amazon s3 They

9:56

kind of came out and said hey you got want

9:59

to put stuff somewhere And you'll probably have

10:01

clicked on files at some point

10:03

and you see in the URL,

10:05

it says like bucket or S3

10:08

dot or a US

10:10

East. It's like in the URL of the

10:12

name. It often will say these words and

10:14

that's kind of how you can tell that,

10:16

oh, these files are actually being hosted on

10:18

Amazon S3. And then

10:20

along with Amazon S3, there's a whole

10:22

bunch of different options out there. Cloudflare

10:25

R2, which I thought was kind of funny.

10:28

They took the letter in the number before

10:30

S3 and named it. But

10:32

then as I made this list, I

10:34

realized backblaze B2 is also like,

10:36

did they do the two because of Amazon

10:39

S3 and then what's up with that? Yeah,

10:42

I, I'm assuming they did that. And

10:45

then Synology has one which I

10:47

didn't realize C2 and then all

10:49

the usual suspects, Google cloud storage,

10:51

Azure, digital ocean, Oracle, they

10:53

all have this and often they

10:56

are all S3 compatible, meaning that if you

10:58

have, if you just take a library, like

11:00

Scott was talking to me about pocket

11:03

base and you can, you can hook

11:05

it up so that it'll, it'll

11:07

upload files to S3, but you can just

11:09

take your cloudflare R2 credentials

11:11

or your backblaze B2 credentials and pop

11:13

them in there because a lot of

11:16

these APIs are S3 compatible. So they'll

11:18

work with, with anything. Yeah.

11:20

S3 was certainly the big player

11:23

for a very long time. Yeah.

11:27

I find myself using backblaze B2 anytime I

11:29

need to host anything anywhere, just because I'm

11:31

very familiar with it. However,

11:33

cloudflare R2. Yeah. I

11:36

like cloudflare a lot. Maybe, maybe I'll try that sometime. Yeah. You're

11:40

going to hear us talk a lot about backblaze

11:42

and cloudflare both because

11:44

like I've, I've used backblaze,

11:48

Amazon S3, cloudflare,

11:51

Google cloud storage, and

11:53

Azure store. I've used all of those, but

11:56

I like cloudflare and backblaze the best and

11:58

I'll tell you why and just. them

26:00

on backblaze and you need

26:02

to download the file in order to work with it

26:04

in a worker. That's free because

26:06

it's just going data center to data center

26:08

and it's not really costing them that much

26:10

as they got a fat pipe between

26:13

the two of them. You're really

26:15

killing the metaphor today. Thank

26:18

you. Thank you. Who else

26:20

is part of this? Azure and Google Cloud are

26:22

discounted, they say, and then there's

26:24

free. I'm trying to see any of

26:26

the big ones out there. There's a list of

26:28

automatic is a big one, which is kind of

26:30

interesting. So I guess like if you've got a

26:32

massive WordPress site and you

26:35

want to move your WordPress files to

26:37

Cloudflare, you could, or vice versa. Dreamhost,

26:40

Backblaze, Oracle,

26:43

and then there's a bunch I have never heard of here.

26:46

Last thing we have here is just operation fees.

26:48

These also cost money. So every

26:52

time that you create a what's called a bucket,

26:54

which is kind of like a folder in these

26:56

cloud providers, that's an action.

26:59

It's an API hit, create a bucket. Every

27:02

time you upload a chunk to a file,

27:04

that's an action. Every time

27:06

you see if a file exists, that's

27:09

an action. Every time you delete a

27:11

file, that's an action. Most

27:13

of those actions, except for deleting files, they

27:17

charge you by the million for

27:19

those actions. So there's not a

27:21

ton of them, but every single

27:23

request of a URL, it

27:25

has to pull up that file that

27:27

lives behind that URL. And that is one action.

27:30

And the cost for those are

27:32

relatively minimal. What have we got

27:34

here? Cloudflare puts them into class

27:36

A and class B operations, which

27:39

is class A is like upload, list

27:41

a file, list files in a bucket,

27:44

list all of my buckets. And

27:46

then class B is like check if

27:48

a file is there or get

27:51

the file size, but not download the file. So

27:53

those are 1 million for $4.50 a month. And

27:59

then 10.

Rate

Join Podchaser to...

  • Rate podcasts and episodes
  • Follow podcasts and creators
  • Create podcast and episode lists
  • & much more

Episode Tags

Do you host or manage this podcast?
Claim and edit this page to your liking.
,

Unlock more with Podchaser Pro

  • Audience Insights
  • Contact Information
  • Demographics
  • Charts
  • Sponsor History
  • and More!
Pro Features