Full Transcript Diet Changes and the Study Idea 0:00 Look at you all. >> I can see some differences just by 0:02 looking at you. >> We actually saw profound changes based 0:05 on what diet they were eating. >> Those lines look very different, don't 0:08 they? >> That's a huge difference. 0:10 >> In just 8 weeks, >> it shocked me. 0:12 >> We can solve a lot of the issues that are hurting us by just rethinking what's 0:17 at the end of our fork. I met a girl. She lived in California. I had been on 0:22 the East Coast. I quit my job. Moved back to California for her with her. And 0:28 then she dumped me and she was a vegetarian and I was not. And I thought 0:33 maybe if I become a vegetarian she'll take me back. So I became a vegetarian 0:37 in 1983 which is what 42 years ago. She did not 0:42 take me back but I stayed vegetarian. This study that turned into a Netflix 0:49 docue series. I'm going to focus on that for a number 0:53 of reasons. One because part of the intervention is a vegan diet. Now I got 0:58 to tell you this was never my idea from the beginning. This guy Luis Ahoyos 1:03 approached us. He had won an Academy Award more than a decade ago for The 1:07 Cove. This was a documentary about dolphin slaughter in Japan and they were 1:12 feeding Japanese school children mercury laden dolphin meat 1:19 and and getting away with it. So this was a documentary expose the cove. We 1:23 got an Academy Award. I don't know how many of you are athletes or have ever 1:27 heard of this, but four or five years ago, he had another documentary called 1:31 The Game Changers. And this was all vegan athletes. This is all elite vegan 1:37 athletes at the top of their game, not eating any animal products whatsoever. 1:42 That was pretty popular. He came to me and a colleague who works 1:46 on the microbiome, which is a hot topic in my field of health right now, your 1:50 gut microbiome and the microbes in there. 1:53 They said,"I would really like to do a new movie and I would like it have to do 1:58 the it should involve diet and it should involve the microbiome." And it has 2:03 become such an important part of my life that I now differentiate my life into 2:08 these three segments right here. Before Louie, before Netflix, and after 2:14 Netflix. So, let me get you my quick little story of how this all happened. 2:19 He approached us in the fall of 2021. At which point my career was already doing
How the Twin Study Was Designed 2:25 pretty well. I had grown up in New Hampshire, the live free or die state. 2:29 Went to college in the east east coast. Got my job at Stanford. I do a lot with 2:35 the American Heart Association, the American Diabetes Association. I worked 2:39 with the chefs to create a group called the Menus of Change University Research 2:43 Collaborative. on the Stanford campus. I started a plant-based diet initiative. 2:49 And I get to work with some of the world's authorities on the microbiome, 2:54 Justin and Erica Sundenberg, both PhDs. They both work in the same lab together, 2:59 husband and wife, and they are just phenomenal. 3:02 Louie approached us and he said, "Okay, I got this idea. I have money for you to 3:07 do a study and I have a potential contract with Netflix 3:11 if you will run a study and let me film the study participants and go off on my 3:17 own while you're doing other things and film other people and put it together. 3:21 The only guidelines I have for you is I want the diet to be vegan and I want the 3:27 participants to be identical twins. I thought I 3:32 identical twins, man, it's really hard to recruit for a study. Won't it be 3:36 really really hard to recruit identical twins for a study? So, we had a whole 3:41 bunch of Zoom calls. And he said, you know, I do have money. He said, "All 3:45 right, all right. All right. All right. All right. You got money. You're going 3:48 to help us recruit the twins. This sounds fascinating. We've never 3:52 done anything like this before working with a film producer. We are willing to 3:56 give it a try. We designed a study that would have 22 pairs of twins where we 4:04 would deliver food. I'm going to go into this in more detail in a little bit for 4:08 four weeks and then they'd be on their own for four weeks and we get their 4:11 blood and their poop and other stuff and we'd have a study and we'd send 4:15 everything out to the lab. And he said, "Yeah, you can do that and I'll be 4:19 filming your participants and I'll be filming other things at the 4:24 same time." And we got pretty much wrapped up in the study more than the 4:29 movie because they did all this and we finished the study quicker than we've 4:33 ever finished a study before. We finished like from January to August of 4:38 2022. We did the whole study. At which point when we're done with a study, we 4:43 have to take blood and poop and other samples and send them out to 4:46 laboratories and wait to get the results back. And then we have to type it up and 4:50 then we have to submit it to a journal. And by now it's 2023 and we've submitted 4:55 to the journal and we're waiting to get it published. If you don't know how how 4:59 this works, it's horribly slow. You submit it, they reject it, you submit it 5:05 somewhere else. They say maybe only if you fix it, if you do this other thing 5:10 and time goes on and on and on and we actually kind of completely forgot about 5:15 the whole movie thing cuz we were trying so hard to do the science and get it 5:20 published. And in the end of 2023, we got this published in one of the JAMA 5:26 networks of publications, JAMA Network Open, which is a really, it's not the 5:31 top medical journal, but it's pretty good. It's a sister journal of the main 5:36 journal, American Medical Association. So, super happy that we got this in a 5:41 good scientific paper. It looks good on my resume. And then there's a thing 5:45 called an altmetric score that I'm going to tell you about later about how much 5:50 the social media and traditional media have covered it. And they covered the 5:53 heck out of it. So in November and December of 23, 5:59 our lives were super busy talking science with everybody about our new 6:03 paper. And to be honest, we had pretty much completely forgotten about the 6:08 whole movie thing. And then the movie had always, according to Louie, been 6:13 planned to be released on January 1st, 2024 when people make their New Year's 6:18 resolutions. That was his original contract with Netflix. He started this 6:22 in the fall of 2021 and knew he wanted to release it in January of 2024. And he 6:28 did. And oh my gosh, we got so much love at first. 50 million people watched the
Running the Trial and Publishing the Results 6:35 docue series in January. And then came the criticism. So people, it got so many 6:41 people watched it that some people watched it and gave us a hard time. And 6:45 all of a sudden a huge amount of my time was saying, "Yes, thank you for the 6:48 praise." And oh my god, why are you slandering me and why is social media 6:52 ripping us apart? This is ah this isn't fun. Okay, so that was kind of what was 6:58 behind what was going on. And and in 7:01 retrospect, I can already say given how many people have told me they changed 7:06 their diet because of the docu series and are eating more 7:10 plants or going vegetarian. That was not the best study I've ever 7:15 run. I've run more than 25 studies. That was like my 10th best study, but nothing 7:20 I've done in my entire career has been imp as impactful as this thing that 7:25 ended up on Netflix. It's just been amazing. So, I want to just quickly tell 7:29 you the scientific part of the study. I don't know how many of you will like 7:34 these details, but just so you know, it had a hypothesis. If we I if we 7:38 randomize identical twins to a healthy vegan or a healthy omnivorous diet, and 7:43 I'm going to describe later why I said healthy, for just eight weeks, which is 7:48 really not that long, those randomized to the healthy vegan group would lower 7:52 their LDL cholesterol, which would be the primary outcome of the study, which 7:57 wasn't really rocket science. If you go vegan, you're going to have less 8:01 saturated fat and more fiber. I would actually be stunned if that did not 8:06 lower your LDL cholesterol. So, this is not really a very risky hypothesis. This 8:12 is pretty darn straightforward, but we did measure everything else under the 8:16 sun that we could with the money that we had. We thought many other things might 8:20 improve. Also, they were filming us while we were doing this. We had 44 8:24 individuals, 22 pairs. You're going to see in a minute who was featured in the 8:29 documentary. It looked like we had a very diverse group of people featured, 8:32 but to be honest, it was like 3/4 women and very much a non-Hispanic white 8:37 population. It's in the PaloAlto area, so they were quite educated. 8:42 The nice thing was of all the people in the study, only one person quit in the 8:47 middle, which is very good for something like a nutrition intervention trial. 8:51 Because they were twins, that meant their twin couldn't be in the final 8:55 study either because you had to m we were matching them to themselves. So the 8:59 other twin was mad, but other than that, we only had one person drop out in the 9:04 whole study just out of a term that we use called internal validity. This is 9:08 really good for our internal validity that so many people finished. They all 9:12 got food delivered for the first four weeks, whether they were vegan or 9:16 staying omnivore. They were all omnivores to begin with, and then they 9:20 had to make food on their own for the next four weeks. And the blood was for 9:24 cholesterol and glucose and things like that. And the poop was for the 9:28 microbiome. And we did lots of questionnaers. 9:31 We found a company that would deliver food to them. So they delivered 9:35 delicious vegan and delicious omnivorous diets. 9:40 And the two of the words that I use in my in my world are efficacy and 9:45 effectiveness. Efficacy sort of is if if you've made 9:49 this as rigorous as possible and controlled everything you can like 9:53 delivering them the food. That's a different question than if people are 9:57 cooking for themselves. We call that effectiveness. It's more generalizable. 10:01 So really this this particular study had two domains. In the first one, it was 10:06 more rigorous when we delivered the food and it was more generalizable when they 10:10 were cooking or themselves, if that makes sense. So we're trying to hit both 10:13 of those. In my world of nutrition, there's something called the healthy 10:17 eating index. And if you add up all the different foods you're eating, people 10:20 have come up with an algorithm that says how healthy the overall set of meals 10:26 you're eating are. And the scale goes from zero to 100. And these are some 10:31 data points with three here's a some graphs, some lines with three data 10:35 points. Baseline when they when they were finished getting their meals 10:39 delivered and when they finished making them their on their own. Here 10:44 for reference, I want to tell you that the average American on a score of 0 to 10:47 100 scores a 60. I'm a professor. When I grade people's papers, if they got a 60, 10:54 they fail. That is a D. So, America fails. America's diet is not good. 11:02 Okay. So, we made a really great healthy vegan diet for people. But I got a 11:07 little side story to tell you here. We also didn't want to set the omnivore 11:12 group up to be a straw man to knock over and we actually made their diet better 11:17 than it was at baseline. Does that make sense? We were actually serving them 11:21 healthier omnivorous food than they normally ate. Now, both of them dropped 11:27 off when we stopped feeding them. But we're super proud that both groups at 11:32 the end of the study, even the omnivores, were eating what would 11:36 objectively be called a healthier diet than they were at the beginning. Now, 11:40 keep in mind that probably undermines our opportunity to show a difference. If 11:45 the omnivores had stayed at their crappy usual diet and that there were health 11:49 benefits of changing your diet, this actually undermined our ability to show 11:55 the difference if we made their diet better. Does that make sense? But I'm a 12:00 firm believer in my new favorite word, equipoise, which basically means try to 12:05 make it fair. Try to give both diets a fair shot. Don't rig it for the purpose 12:10 of headlines that you won because you made the other diet crappy on purpose 12:16 and it's not really fair. So, we're super proud that we did that. Here's the 12:21 results. Drum roll, please. The main outcome had been LDL cholesterol. And 12:27 son of a gun, the vegans lowered their LDL cholesterol and the omnivores 12:30 didn't. That's pretty much to be expected. They had less saturated fat 12:36 and more fiber, which is pretty normal for a vegan diet. That was statistically
Netflix Release and Public Reaction 12:41 significant. This is called a probability score. It's like a 12:45 percentage. 0.02 is like there's a 2% chance this difference was by chance 12:51 alone and there's a 98% chance this is real. So we did that with lots of other 12:57 things, HDL cholesterol, triglyceride, glucose, insulin, other things. And it 13:01 turned out two other things were statistically significant. The fasting 13:06 insulin levels had a low probability of being by chance alone. And their weight 13:11 dropped on the vegan diet compared to the omnivores. Some of these others were 13:15 in the right direction, but as a scientist, I have to focus on the things 13:18 that were statistically significant. So, as LDL, insulin, and weight were all 13:25 better. Okay. Tada. What are the strengths of this? Oh, it was a 13:30 randomized clinical trial in my world. That's a big deal. Identical twins. Oh 13:36 my god, that was such a cool aspect of this. Like, there's always genetic 13:39 differences between people. And because they were identical twins, we negated 13:43 that. And boy, we had really high retention. We kept people in the study 13:48 except for that one person and they did a good job of adhering to the diet. Even 13:53 when they were on their own, they were eating better than before the study 13:56 according to the data. Now, it honestly it was a small sample size and it was 14:02 only 8 weeks and it really wasn't very generalizable. It was mostly white 14:06 well-educated women, but it's pretty good for what it was. No studies are 14:12 perfect. So we concluded that the vegan diet led to improved cardioabolic 14:18 outcomes. According to all the standard processes of science that we went 14:23 through, clinicians can consider this dietary approach as a healthy 14:26 alternative for their patients. And that's the science of it. Well, what 14:33 was interesting after that was some of our colleagues said, "Oh, that's so 14:37 great that you have blood. Can we borrow some of it? And can we look at some 14:42 biological clock things that we found? I don't have time to go into this in 14:47 detail. So, I'm just going to use this word epigenetic. 14:51 So, epigenetics is different than genetics. You can't change your 14:55 genetics, but there's a way to modify what kind of proteins get made from your 15:01 genes. And so, this is called the field of 15:04 epigenetics. So you can actually modify what happens with your DNA. And the 15:10 people in this field have come up with what they call biological clocks. And 15:15 they say that biological clock is different than your chronological clock. 15:18 You might be 60 years old, but it might be that if we look at your epigenetics, 15:23 there's a biological clock that says you're 40 years old or or older. You 15:29 could be younger or older because of your metabolism. And there's another 15:34 thing called tieamir length. Tieumirs are the caps on the end of your 15:38 chromosomes. And as we age, the caps get shorter and shorter. 15:43 It looks like people with the longest caps, they're like protective caps on 15:47 the end of our chromosomes. As those get longer, people tend to be live longer 15:52 lives, have more longevity. So a group said, "Hey, we want to look 15:56 at this in your data set." I said, "Are you crazy? It was only eight weeks. What 16:02 what is gonna happen to longevity in eight weeks? Well, they actually found 16:07 that the biological clocks and the telomeirs looked better for the vegans 16:13 than their omnivore identical twins in just 8 weeks. And they published their 16:18 own paper and oh my god, the headlines were all over the place for their paper
Secondary Analyses and Media Attention 16:23 which was a secondary analysis. This is like after the fact. Let's look at this. 16:28 So remember I mentioned before this thing called an altmetric score. This is 16:32 the thing about news outlets and Twitter users and Facebook and Wikipedia 16:38 and other things. And so a good almetric score like social and traditional media 16:44 if you get a score of 20 it's pretty good. People noticed your publication. 16:49 So here's our main paper. We got a score of 2,000. Okay. So people really noticed 16:55 our research paper. Okay. But this is a little humiliating. The genetics people 17:01 who just did a little thing on the side had more press than we did in social and 17:08 traditional media. I think that's pretty funny. And we actually have some 17:13 positive microbiome results that were better for the vegans than the 17:16 omnivores, but those are pending and haven't been published yet, so I can't 17:20 talk about them yet. That was our study. Okay, so hopefully you got at least a 17:26 rough idea of what the study was. Okay, so here's what was bizarre again. So let 17:32 me go back to this old map of, oh, we were going through this thing. Louie 17:36 came to this with the idea in the fall and wow, we didn't finish the study till 17:40 the end of 2022 and then it took us a year to get published and we forgot 17:44 about all the other stuff that was going to happen until oh my god, it's a 17:50 Netflix movie. Here I am actually in Kyua on 17:56 January 1st, 2024. And my wife says, "Quick, come come and look." I said, 18:02 "What?" And she said, "Holy crap, you're third on Netflix with your study." Said, 18:08 "Oh my god, like I I actually didn't know all the other stuff he was 18:14 filming." And I thought, "Wow, maybe we'll be on the cutting room floor. I 18:17 know he was filming a lot of other stuff. I wonder how much will be 18:21 included. Holy crap. And here's where I finally 18:25 realized Louis genius. I thought he picked genetic identical twins as sort 18:31 of a scientific leg up. Oh, and I do think this is why a good scientific 18:36 journal took our research paper and published it cuz wow, what a novel thing 18:40 to do a diet intervention in identical twins where genetics is controlled for. 18:45 How scientific. But Louie was much smarter than that. Aren't they adorable? 18:52 Look at that. Identical twins are so fun. Oh my god, they were hilarious. And 18:59 they handpicked four pairs that were particularly 19:03 adorable and that were very racially, ethnically diverse, too. I'm sure they 19:09 did that on purpose. Okay, so here they are in the study for eight weeks. They 19:14 fil they just featured those four. They couldn't follow 44 people around, but 19:18 they followed eight people around and filmed all kinds of things that they 19:23 did. One of the things they filmed them doing was working out. They actually had 19:26 an exercise instructor, and this is a small point of contention that I'm going 19:31 to bring up just to defend myself. We really measured a lot of stuff and 19:36 paid a lot of money. And there's a way to get a really detailed analysis of how 19:41 much body fat, body muscle, and bone you have. and my budget was out. I didn't
Documentary Highlights and Broader Food Issues 19:46 have any more money. And I told a producer I could not do that. He said, 19:50 "Well, I'm just going to do it in the eight people then. I'm going to do it on 19:53 my own without you, Christopher." I said, "That's fine, but I'm not going to 19:57 put it in the research paper cuz eight isn't enough. I have to have it for 20:01 everybody." And there were people who watched the documentary. And some of the 20:06 vegans lost muscle in this small group. And they read our research paper and 20:12 they said, "Oh, Professor Garter, you are so unethical. You only published the 20:18 things that work. You didn't publish the things that didn't work. Oh, you're 20:23 corrupt." And I I had to defend myself and I said, "No, I never saw these data. 20:28 The guy just did this on his own." I'm thinking, Louie, why did you publish 20:34 that that part where it's like they actually did lose more liver fat and 20:38 visceral fat, but they also lost muscle. It wasn't a very easy message. I was 20:43 like, God, of all the great stuff you filmed, I I kind of don't even know why 20:48 you included in the documentary, but then it was quite obvious. This was the 20:52 trainer for the movie. This is Nei Delgado. He's been vegan since he was 20:57 born. This is like the opportunity to say, 21:01 "Here's the super uber ripped buff vegan dude. You can all be like him if you go 21:09 vegan." Right? So, this part wasn't actually 21:12 very scientific, but it cracked me up. And Neimi is a really interesting guy 21:17 and he is vegan and he's enormous and he wins medals and he was in the previous 21:22 movie Game Changers. But then Louiesie found a three-star 21:28 Michelin restaurant in New York where the owner had gone vegan. 21:35 Uh he actually stayed vegan for many years. Just recently he started adding a 21:40 few animal source things to stay afloat. But this is a big deal. He filmed why 21:45 chef Daniel Hum went vegan at a Michelin star restaurant. And after going vegan, 21:50 he retained his three stars. And he knew that Cy Booker was vegetarian. And so he 21:56 interviewed him in the movie. And he knew that Eric Adams, the mayor of New 22:00 York City, was vegetarian and had helped the hospitals in New York go 22:04 plantforward first. So New York City hospitals now take their hospital 22:08 patients. Ruth, I don't know if they did this for you, but they said the first 22:12 option is plant-based. Oh, if you want something else, you have to ask for it. 22:17 So he even wrote a book about this. He interviewed a chicken farmer who had 22:22 quit being a concentrated animal feeding operation chicken farmer and 22:26 transitioned to mushrooms. And in the movie, he talked about all the different 22:31 things that were going on in the world of food. How many animals were raised in 22:36 industrial feed lots as opposed to being grass-fed. 22:40 He talked to a regenerative cattle rancher 22:44 who went to eat at the vegan restaurant owner's restaurant. I thought that was 22:48 pretty clever. He brought up all the masses of the wild animals across the 22:54 planet compared to how many cows raised for meat, which is just horrifying. Like 22:58 a 20fold difference in cows raised for meat versus all the other wild animals 23:03 on the earth. He talked about how much the how much of the animals come from 23:09 concentrated animal feeding operations in the US. I don't know what it is on 23:12 the islands, but it is almost all kayo on the states. talked about the lagoons 23:19 of manure that get generated as they wash the poop and pee out of these huge 23:23 facilities. And even what do they do with that? They spray it on the fields. 23:28 And one of the interviewees for the documentary was this woman who lives 23:32 next to a concentrated animal feeding operation. Her home, her laundry, and 23:36 her kids were being sprayed with the feces 23:41 coming from these lagoons of manure. talked to a trial lawyer activist that 23:49 did a weird little series about the contamination of chicken under a black 23:54 light. That was actually pretty funny. These are one pair of twins react. Look 23:58 at their teeth showing up bright white in the light. Marian Nestle, who's a 24:03 famous public health nutritionist, and somebody from the NRDC. 24:08 Brilliant. So, we didn't end up on the cutting room floor. We were featured 24:12 throughout the whole documentary. we were the theme that tied four different 24:18 90minute segments together. So, it's like six hours of video, 24:24 but he also brought in all these different voices around a plant-based 24:29 vegan diet. And it was brilliant. It was really well done. [music] 24:40 >> [music] 24:50 >> Heat. Hey, heat. Hey, heat.
Comments