Fish and seafood are excellent sources of nutrients such as omega-3 fatty acids, Vitamin D, and selenium. The aims of this study were to examine the pattern of seafood consumption among Canadians and determine their contribution to intakes of energy and nutrients. Day-1 24-h dietary recalls data collected from a national survey, the Canadian Community Health Survey—Nutrition in 2004 and 2015, were used to estimate food and nutrient intakes among Canadians. Seafood was classified according to the Bureau of Nutritional Sciences food list. Descriptive statistics were used to calculate the consumption rate and the average consumption amount of seafood by different age groups and sociodemographic characteristics. Population ratios were used to assess the contribution of seafood to the total intake of energy and nutrients. The overall consumption rate of seafood was around 17%, and the rate was similar between males and females, and slightly higher in 2015 (17.71%) compared to 2004 (16.38%). The average portion size is approximately 100 g, which translates into a ≈36 kg annual intake among the consumers and ≈6.2 kg per capita consumption. Adults (especially 30 years and above), Asians, individuals who were married, and with post-secondary education were more likely to consume seafood. Salmon, tuna, shrimp, cod, and crab were the most frequently consumed seafood in Canada, the consumption rate of which all increased from 2004 to 2015. Seafood provided up to 75% of n-3 PUFAs, 18% of Vitamin D, 19% Vitamin B12, 6% of niacin, and 4% of Vitamin B6 from all food sources. Seafood consumers had a healthier diet, as seafood consumption was related to a higher intake of key nutrients and a lower intake of total sugar and saturated fatty acids. Therefore, fish consumption should be promoted among Canadians.