This paper introduces various barriers hindering the introduction of ethnography in support of public service design improvement in Japan, and discusses ways to overcome these barriers. Service design approaches using ethnography are gaining popularity in the public sector, especially in Europe. In Japan, however, local governments have adopted few or no ethnographic methods in order to improve public services. One of the most difficult barriers to the establishment of ethnographic approaches in Japan is the long-lasting relationships between citizens and local governments. Ethnographers engage in competition with citizens and are accused of bias, making it difficult for local governments to conduct ethnographic research freely and understand their citizens in depth. In order to overcome these barriers, this paper proposes three approaches about introducing areas, research protocols and organizations.