A mechanistic understanding of human activity patterns lays a foundation for many applications. The majority of the current research aims to outline human activity patterns mainly from spatiotemporal perspectives (i.e., modeling human mobility patterns), lacking of understanding of the motivations behind behaviors. The aim of a recently published study is to model and understand human activity patterns within urban areas using both spatiotemporal and cognitive psychology methods to measure both human behavior patterns and the underlying motivations. We first propose a framework that enables us to analyze the spatiotemporal patterns of urban human activities, infer the associated semantic patterns that represent the motivations driving human mobility choices and behaviors, and measure the similarity between human activities. We then construct a human activity network based on the similarity to depict human activity patterns. The framework is applied to a case study of Toronto, Canada, where geotagged tweets are used as a proxy for human activities to explore activity patterns. The analysis of the human activity network shows that 61% of tweeter users follow similar activity patterns. Our work provides a new tool for better understanding the way individuals interact with urban environments that could be applied to a variety of urban applications.