Justin and Hailey Bieber are spending a celebratory weekend together, following the July 11 release of 'Swag,' Justin's first solo album in more than four years. A source familiar with the creation of the album tells PEOPLE that the Rhode founder supported her husband throughout the entire process.

Justin Bieber's surprise 'Swag' album marks his first release in four years, and the most creative and wide-ranging music of his life