Patrick Schwarzenegger Talks Growing Up with 'Very Strict' Parents Maria Shriver and Arnold Schwarzenegger

Patrick Schwarzenegger admittedly grew up with a healthy amount of fear of his parents.

The White Lotus star, 31, stopped by The Drew Barrymore Show on Tuesday, March 25, and revealed during a game of Fast Five that his mom Maria Shriver and dad Arnold Schwarzenegger "were frightening" when he was growing up.

Shriver, 69, appeared in a pre-recorded video where she asked her son a few questions. When she asked what he "got away with as a kid" that she wasn't aware of, he said, "I didn't do anything ... I didn't want to do anything against Maria and Arnold."

That admission prompted host Drew Barrymore to jump in and ask how Patrick's parents got him to behave so well. "Wait, I kind of want to know what did they do because I want to do that to my children," she said.

"Oh man. We just had a lot of rules," Patrick said. "They were very strict parents. I'm worried I'm gonna get grounded if I say something now."

Shriver's next question was, "What's the best piece of advice I've ever given to you?"

"My mom has given me so much advice," Patrick said. "Maybe just finding ways to give back. I feel like God blessed me with a really amazing life and family. And [I] find ways to kind of utilize my platform and who we are to give back."

That answer impressed Barrymore, too, as she called Patrick "good-hearted" and admitted, "Gosh, I need to ask your parents for advice."

Patrick's famous family has been something of a hot topic in recent weeks as his biggest role to date in The White Lotus season 3 has been airing.

In an interview with Victoria Garrick Browne on Dear Media's Real Pod last month, he admitted that the "number one question" he's asked by people is: "Are you so worried about living in your dad's shadow? Or, How does that weigh on you? And, Do you ever think you'll be more successful than him?"

"To me, one of the things that I've learned probably the most — and probably from my mom more than my dad — is just: What is success to you? And really making sure you have a clear understanding of what you value in life," he revealed.

While his dad's values were more aligned with his desire to "be the biggest movie star in the world... the biggest bodybuilder in the world... the biggest politician," Patrick said he's more interested in prioritizing his "family, faith, relationships, friends" and his fiancée Abby Champion.

"I really learned that a lot from my mom and just having really kind of defined areas of [what success means]," he said.

"And I bring that up because I don't — I'm not worried so much about how successful my dad is or was, and same with my mom. I just really care about carving my own path, and wanting to feel successful to me. I'm never gonna out-succeed my dad in his terms. But in my terms, I will."

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

The Drew Barrymore Show airs weekdays on CBS. Check local listings.