Nowadays, the knowledge base of Question Answering system, usually stores question answering pairs or text content extracted from web pages. But in last decades, in order to improve work efficiency, many enterprises had made large investment on ERP (Enterprise Resource Planning) and MIS (Management Information System). And the systems have accumulated a great deal of useful business knowledge, of which the majority is in relational databases. Therefore, how to retrieval knowledge intelligently from relational databases with nature language makes practical significance. To deal with this situation, with the help of the idea of Box Computing, the paper presents the technology of Question Answering with web service. Considering the features of web service, the paper adopts question patterns matching with web service. And based on similarity calculation of user questions and question patterns, it is able to provide the accurate data service for the purpose of answering. This paper includes two types of web services: web API (Application Programming Interface) and web APP (Application).And it is propitious to reuse web service developed for shortening the time of exploiting.