- Research Article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Development and testing of an online community care platform for frail older adults in the Netherlands: a user-centred design
© The Author(s). 2018
Received: 10 July 2017
Accepted: 26 March 2018
Published: 7 April 2018
Recent transitions in long-term care in the Netherlands have major consequences for community-dwelling older adults. A new paradigm expects them to manage and arrange their own care and support as much as possible. Technology can support this shift. A study has been conducted to explore the needs of community-dwelling frail older adults with regard to an online platform. An existing platform was subsequently modified, based upon these needs, resulting in an online community care platform (OCC-platform) comprising of care, health, and communication functions. The purpose of this platform was to support frail older adults in their independence and functioning, by stimulating self-care and providing reliable information, products and services.
The study used a User-Centred Design. The development processes involved the following steps: Step 1) Identification of the User Requirements. To assess the user requirements, direct observations (N = 3) and interviews (N = 14) were performed. Step 2) Modification of an Existing Online Platform. Based upon Step 1, available online platforms were explored to determine whether an existing useful product was available. Two companies collaborated in modifying such a platform; Step 3) Testing the Modified Platform. A total of 73 older adults were invited to test a prototype of the OCC-platform during 6 months, which comprised of two phases: (1) a training phase; and (2) a testing phase.
An iterative process of modifications resulted in an interactive software concept on a Standard PC, containing 11 Functions. The Functions of ‘contacts’, ‘services’ and ‘messaging’, were by far, the most frequently used. The use was at its highest during the first 2 weeks of the testing and then its use steadily declined. The vast majority of the subjects (94%) were positive about the usability of the platform. Only a minority of the subjects (27%) indicated that the platform had added value for them.
The overall prospect was that an OCC-platform can contribute to the social participation and the self-management competencies of frail older adults, together with their social cohesion in the community. In order to validate these prospects, further research is needed on the characteristics and the impact of online platforms.
Recent transitions in long-term care in the Netherlands have major consequences for community-dwelling older adults. They are now encouraged to stay at home for as long as possible. The responsibilities for care are now shifting from the health care system to older adults themselves, together with their social network. This shifting creates a new paradigm in which self-management competencies are highly valued. This new paradigm expects older adults to manage and arrange their own care and support, and if needed, to be supported by their social network (i.e. neighbours, family, friends) .
Most older people are relatively healthy, living independently in their own homes, and participating in their own community. Older adults who are vital and active will probably not experience many difficulties when self-managing their own care. Nevertheless, up to 38.5% of older adults are considered to be frail, with an increased risk for (further) functional decline and institutionalisation . Frailty is defined as “a dynamic state which influences a person that experiences a loss in one or more domains of human functioning (physical, psychological, social)” . This frailty can transpire due to a range of diseases and medical conditions . The rapid increase of frail older adults with chronic diseases, multimorbidity, as well as complex health problems, affects the demand for health care services, while at the same time, financial resources and manpower are both shrinking [4, 5].
We will only succeed in this evolving transition when we search for comprehensive new and smart strategies, in a close collaboration between all of the stakeholders involved. Technology can support these strategies. An example is an online platform offering an infrastructure, in order to interlink people, provide access to professional services, as well as to promote (‘real life’) encounters and mutual activities [6–8]. An online platform is a coherent combination of hardware and software components that are able to provide a base upon which software applications can operate.
There are dozens of online health and welfare platforms. These mainly focus on delivering health care services and they are primarily developed from the perspective of health care professionals [9, 10]. Frail community-dwelling older adults especially need support in other domains, such as access to information, services, and communication .
We have conducted a study to explore the needs of community-dwelling frail older adults, with regard to an online platform. An existing platform was then modified, based upon these needs. This resulted in an online community care platform (OCC-platform) that comprised of health, well-being, and communication functions. The purpose of this platform was to support frail older adults in their independence and functioning, by stimulating self-care and providing reliable information, products and services. The main aims of the study were: 1) to modify an existing online platform, based upon the needs of frail older adults, and 2) to test this modified prototype platform on the usability and the feasibility of frail older adults.
Step 1: User requirements
In order to assess the personal needs and the requirements of frail older adults, direct observations and interviews were performed. Various organisations (e.g. a client-interest group, a hospital, and a local municipality) were asked to select suitable candidates (i.e. people who were living at home, and over 65, N = 17) to be included in this part of the study. This resulted in 17 frail older adults who participated in either the direct observations (N = 3), or the interviews (N = 14).
Interview topics and questions
Examples of the Interview Questions
With whom are you currently in touch with the most?
In which (community) activities do you participate?
What welfare services do you use?
With which health care professionals do you have contact?
What techniques would you like to use, in order to communicate with professionals or other people?
If a device were to be developed, in order to enable remote communication, what requirements should it meet?
Expectations Regarding Technology
How do you feel about remote communication?
Affinity With Technology
Are you experienced when working with computers?
For what purposes do you use a computer?
The results from the observations and the interviews were used to draft ‘use cases’, as well as narratives about the ‘modus operandi’ of the OCC-platform. This was all from the perspective of the proposed users . These use cases were discussed and they were optimised by a geriatrician, a practitioner nurse, as well as the representatives of the frail older adults, together with four of the researchers. The final use cases were converted into user requirements, and then subsequently, they were divided into functional and technical requirements.
Step 2: Development of the prototype platform
Based upon Step 1, the field of online platforms was explored, in order to determine whether an existing product was befittingly available. We sought for an existing useful online platform that was suitable for older adults, with a low cost, and available in the Dutch language. Furthermore, the owner of the platform had to be willing to modify it, based upon the user requirements. Consequently, several ICT companies were approached and consulted. Finally two companies were selected to work together and to develop a prototype platform. The company that was first selected presented the most promising online platform, as their software was of an ‘open source’, and thus, it was suitable for modification. Moreover, their platform, entitled “Cubigo”, contained certain features which had been labelled as being significant in the user requirements (i.e. communication and information on local services, events and activities). The choice was, therefore, to select their platform. Another company was selected to supply the ‘video call service’, since the platform of the ‘first’ company did not contain such a function.
Feedback-sessions regarding the layout: the researchers and the representatives of the frail older adults were asked to give their feedback on the layout of the platform (e.g. menu structure, visibility). The results were used to improve the platform’s layout.
Tests by the researchers: the researchers were asked to test the prototype platform and to pay special attention to the usability of the platform and to any occurring inaccuracies. The results from these tests were used to improve and to optimise the usability of the platform. These processes were repeated several times.
Tests by the representatives of the frail older adults: the prototype platform was tested in the home-environment of the representatives. The goal of these tests was to try-out several functions of the prototype platform (e.g. the video call services, text messages, and so on.). The representatives were also asked to pay special attention to the usability, the visibility, and the interactions. The results of these tests were used to improve and to optimise the online prototype platform.
After the abovementioned tests, the researchers, the local municipalities, and the care and welfare organisations, all provided content (i.e. information) for the platform. This resulted in a prototype platform that was ready for final testing.
Step 3: Testing the OCC-prototype-platform
In order to test the prototype platform, a panel of participants was monitored for 6 months. Frail older adults were invited to participate via an information letter that was distributed by senior council workers, a hospital, care organisations, welfare organisations, in addition to general practitioners. Suitable participants (i.e. people who met any of the following criteria: aged 65 and older; at a risk of decline in physical, psychological, or social functioning; suffering from a geriatric syndrome; suffering from a specific somatic condition; living independently at home without a partner) were subsequently approached by the project members. The participants were introduced to the OCC-platform by way of a personal instruction and a demonstration. When the participants did not have access to a computer, or the Internet, these were made available to them free of charge. A total of 73 older adults were invited to participate in order to test the OCC-prototype-platform.
The testing comprised of two phases: (1) a training phase; and (2) a testing phase. Both of these phases consisted of tasks that had to be carried out by the participants individually, in their own home, and on their personal computer. The training phase, in order to become familiar with the platform, included various exercises in which the participants were asked to concentrate on specific functions. In the first week, the participants were asked to use the first three functions of the platform and to record their findings in a log. The participants were then contacted by telephone to discuss their findings and to receive a new assignment (i.e. to use the next three functions for a week and to record their findings). These procedures were repeated until the entire platform had been appraised. After these training exercises, the testing phase commenced. The participants were asked to continue using the platform freely and to log their experiences.
More participants were gradually included. The quantitative data of the user frequencies was automatically documented by the platform’s system, in log files, during the entire testing phase. Finally, all of the participants were interviewed in their own homes at the end of the testing phase. This interview consisted of 34 questions of which 23 addressed the usability of the OCC-platform (e.g. logging in to the platform, the menu’s structure and usability of the platform’s functions). The remaining 11 questions were dedicated to user experiences (e.g. did the OCC-platform contribute to feelings of safety and did older adults perceive the platform as having added value). The data were analysed by means of conventional content analyses .
The interviews (Step 1 and Step 3) were transcribed and then they were qualitatively analysed. The data from the user’s log files was imported into SPSS and this was descriptively analysed (an overview of the frequency in which the tools were used and the trends of their use over time). Participants were gradually included into the testing phase (Step 3). As a result, the duration of participation varies from 15 to 30 weeks. To standardize the follow up period we restricted this to 15 weeks for every participant. We excluded the first three and last two weeks of data to avoid learning effects (i.e. we gave users the possibility to get accustomed to the platform) and fade-out effects. Therefore, we analysed the log files on the user frequencies restricted to 10 weeks for every participant.
Wishes and needs regarding daily life, communication and technology
The goal of the direct observations was to gain an insight into the wishes and the needs of the frail older adults regarding their daily life and their communication. The direct observations were conducted at the homes of 3 frail older adults (2 females of 75 and 72 years and a male of 71 years), who all lived independently in their own home and were married. It turned out that they: (1) often stayed at home because it was perceived as being safer; (2) often received health care provided by informal and/or formal caregivers; (3) experienced limitations in their social contacts and they wished to have more face-to-face contact with their family and friends, or to be more involved in the community; (4) were dependent on transportation that was offered by their children or friends. Moreover, the 3 observed older adults felt that telecommunication technologies could improve their well-being and their feelings of safety. An important requirement, however, was that potential interventions should be user-friendly. For instance, the platform should have clear buttons or icons; there should be an easy menu structure; the platform should feature a short and understandable user manual; and it should be suitable for transport.
The interviews were conducted at the homes of 14 older adults and they were focused on their wishes and their needs regarding social participation, communication and technology. The participants (N = 14) had a mean age of 79 (SD = 6) and 9 of them were female. All participants lived independently in their own home and 12 of them were widowed. The results demonstrated that their social network consisted of children, siblings, neighbours and friends. Overall, the interviewees were unsatisfied with the degree of contact that they had with their children and siblings. Depending upon their health, they were involved in all kinds of activities (e.g. viewing sport, church attendance, and so forth.). The interviewees had contact with various health care professionals, such as visiting nurses, general practitioners, nurse practitioners, and physiotherapists. According to the interviewees, an OCC-platform should include the following functions: telephoning (including a video call service), text messaging, distress calls, and a calendar. Although 12 older adults were positive about the concept of an OCC-platform, the majority were not interested in screen-to-screen contact with health care professionals. Approximately 50% of the participants had a basic knowledge of computers and a little fewer than 50% owned a personal computer (PC). The PC owners generally used them for playing games, e-mailing, browsing online, administrative work, internet banking, and social media.
The results from the direct observations and the interviews were used to draft ‘use-cases’. Their structure was as follows: (1) case (e.g. general information, health problems, social problems, hospitalisation, and frailty); (2) intervention (e.g. family, an online platform offered them a support system); (3) ideal situation (e.g. frail people used the OCC-platform and they were satisfied with the functions/features and the usability).
User requirements: functions
Safety & Comfort
Personal Alarm; Smoke, Gas and Burglar Alarm; Intercom;
Meals Delivery Service; Grocery Service; Banking Service; Job Services; Information Provided by Local Municipalities.
Video Calling Services; Chat Room; SMS.
News & Entertainment
Newspaper/Book (Read Aloud);
Calendar with Audio and Reminders; Games to Play Individually.
Distress Call; Good Morning Service provided by a Welfare Organisation.
Service to arrange Transport; Information about Local Events and Activities; Interactive Games; Community Resources listed on an Interactive Map.
Primary Care Consultation (e.g. the practitioner nurse); Clinical Care Consultation (e.g. the clinical geriatrician).
Medication Reminder; Appointment Reminder;
Possibility to ask Questions Online for a Consultation; Results of the Consultation.
Lifestyle Advice/Counselling; Online Contact with Paramedics;
Medication Counselling Online;
Telemedicine (e.g. remote monitoring of psychical parameters).
The OCC-platform also had to meet several technical requirements: usability (the usage and the operation should be easy and intuitive, little to no affinity with computers needed); visibility (big screen for better visibility, use of icons, pictures, photos); flexible interaction (touch screen capability); accurate operation (robust operation, no technical failures during operation); convenience regarding transport (device should be portable, small, light, robust and wearable); it should be possible to add supplementary functions.
Every function was comprised of submenus. The main menu also contained an extra function of “add cubes”, which gave the users the possibility of tailoring the basic screen according to their wishes, by adding, deleting and/or reordering functions (cubes). The development of the previously described OCC-prototype-platform resulted in considerably more time and energy than expected. In order to ensure a tangible involvement of health care providers, (i.e. health care providers who actually provided content for the OCC-platform), several visits and a lot of persuading was necessary. In the end, it took us half a year to persuade the health care providers to provide information content for the OCC-platform.
Testing the OCC-prototype-platform
Of the 73 approached candidates, 55 older adults were included in the testing study. Eventually, 33 of them finished the entire monitoring period of 6 months. Eventually 22 participants withdrew from the study due to hospitalisation, or because they found participation in the study too time consuming. Of the 33 participants that completed the study, 20% were younger than 70 (the youngest was 65) and 60% were 70–80 years old. Eight participants did not have a computer or an Internet connection. These were made available to them, free of charge.
The main topics regarding the usability of the platform were: logging into the platform, the design of the main menu and submenus, the format and structure of the main menu and sub menus, the visibility and recognisability of the buttons, the readability of the text, the brightness of the colours, as well as the clarity and the audibility of the sounds. In general, 33 participants gave a positive score for the usability of the OCC-platform (94% stated that they found the platform easy to use). Nevertheless, several recommendations were made. The most important of these was that the OCC-platform login should be made easier (username and password were often forgotten) and that the number of functions and the arrangement of the functions in the main menu should be individually adaptable. Additionally, the functions and the sub functions gave too much information (too many choices for the selections, too many actions required).
The comments of the participants with respect to their experiences with the platform vastly diverged. The majority of the participants (73%) disagreed with the proposition: "the platform adds value to my daily life". Possibly they perceived themselves as being vital and active and not (yet) in need of support by the OCC-platform. Only 9 of the 33 subjects (27%) indicated that "the platform provided feelings of safety". Two thirds (67%) of the older adults preferred communicating via video, over communication by telephone. Furthermore, 18 of the 33 (55%) had the intention of using the platform actively after the testing period and 27 of the 33 (82%) reported that they would recommend the platform to others. A few of the participants advised the researchers to include some additional functions, such as: home automation (opening and closing the curtains and doors, controlling the heating); monitoring bodily functions (heart rate, blood pressure); a tool for matching care demanders and volunteers; hobbies; public transportation; taxi transportation; and games.
Based upon the user requirements of the frail older adults, an online community care platform was developed and tested on its usability and its feasibility over a six months period. The main aims of the study were: 1) to modify an existing online platform based upon the needs of the frail older adults, and 2) to test this modified prototype platform on its usability and its feasibility among frail older adults.
The most pertinent needs of the participating frail older adults were that they experienced limitations in their social contacts and they wished to have more face-to-face contact with their family and friends, or to be more involved in the community. Overall, the participants felt that telecommunication technologies could improve their well-being and their feelings of safety (i.e. the frail older adults seemed to be receptive to the idea of an OCC-platform). The OCC-platform was modified and optimised by two companies based upon the user requirements. This process resulted in an accessible interactive software concept on a Standard PC, containing 11 Functions (cubes) in the Main Menu. The OCC-platform functions of ‘contacts’, ‘services’ and ‘messaging’ were by far, the most frequently used. The usage of the platform was at its highest during the first 2 weeks of the testing study and then it steadily declined. Although the vast majority of the subjects were positive about the usability of the platform, only a minority (27%) indicated that the platform had added value.
An explanation for the decline in user frequencies was that the first part of the testing study, the training phase, was guided intensively by the researchers. In the second part, the platform was used ‘freely’ without external incentives to do so. The temporary increase of activity in week 7–8 was probably caused by an announcement that in those weeks, there would be an evaluation of activities by the researchers. These results have indicated that the OCC-platform did not produce sufficient incentives to keep the users active. In previous research, a similar low usage of online, or eHealth interventions, has been reported [15–18]. For example, the Dutch eHealth Monitor 2016 demonstrated that despite the availability of many eHealth tools, the end users hardly adopted them. Krijgsman et al. explained that the scarce adaptation of eHealth resulted from a ‘lack of awareness’ (i.e. the end users were unaware of the potential, the possibilities, or even the existence of eHealth). Furthermore, the end users would often rather stick to old habits, than adopt themselves to new ways and means (e.g. using the telephone to make appointments, instead of an online tool, filling out forms on paper, instead of online, and so forth). In order to encourage the adaptation of eHealth, it would be important to actively stimulate the usage and to promote eHealth . Additionally, it would be vital that an eHealth OCC-platform contained content and functions that were of a value for its users.
Furthermore, as explained regarding the OCC-platform-prototype, it took us half a year to persuade the health care providers to provide information for the OCC-platform. It seemed that they partly did not have a clear idea yet of their role or the platform’s added value. Also, it is conceivable that some of them dreaded a possible increase in workload (e.g. using e-consults or video-calling tools, to register and share information via a platform etc.).
As the results have shown, the functions of communication (e.g. messaging) and participation (e.g. my community) were often used. Moreover, the participants seemed to have a preference for communicating via video call services, instead of communicating by telephone. Makai and colleagues  also reported that communication functions (e.g. messaging) were the preferred functions by older users. These results have indicated that an OCC-platform would have the potential to support community-dwelling frail older adults, especially in communication. However, this would only be true for communication between the end users and their family or friends. This would not apply to communication with the health care providers.
Only a quarter of the subjects indicated that the platform had added value. A possible explanation for this might be that OCC-platform technology still needs to be improved (e.g. an easier login), that it lacks specific relevant functions (e.g. transport or home automation), or that the information content was not up to date.
The results have suggested that an OCC-platform has the potential to support community-dwelling older adults, provided that the platform contains content and functions that are of value for its users, in addition to the fact that end users are informed about the platform. In order to accomplish this, the study has several practical recommendations. Firstly, give the end users more control and ownership of the platform. For instance, when the platform is implemented on a community level (e.g. a neighbourhood), it is recommended that local residents are involved, when the customisation of the OCC-platform takes place. Secondly, the membership of the local health care providers and the local (elderly) associations should be involved, in order to make arrangements about their role in providing information content. Thirdly, there is a need to actively stimulate the usage and to promote the OCC-platform via the aforementioned parties. Thus, by intensifying the involvement of the end users, the health care providers, together with the local associations, we can safely assume that the OCC-platform will be promoted. It would then have more added value, as well as containing appealing and up to date content.
The fourth recommendation concerns the manner in which the OCC-platform is to be financed. At present, most of the funding is collected from local entrepreneurs (e.g. bakery, barber shop) who display and advertise their services on the OCC-platform. Due to these business cases, the continuity of the platform would entirely be dependent upon whether entrepreneurs want to use this platform as a promotional medium. Entrepreneurs, however, are not inclined to pay licence fees, in order to advertise on a promotional medium, from which they will only find a few customers. Conversely, the few customers (users) who actually use the OCC-platform can possibly be explained by a lack of the entrepreneurs to display their services. The business case of an OCC-platform will only work if all parties become involved (e.g. health care providers) and are willing to invest financially in an OCC-platform.
Limitations and strengths of the study
This study has some limitations. In view of the modest sample size (especially in the direct observation and the needs part), the results should be interpreted with some caution. For instance, the results regarding the user requirements may not necessarily be applicable to all or other groups of older adults. The strength of this study was that the needs of the target group for this innovation (i.e. the frail older adults) were given extensive consideration at the selection, modification, and the testing of the OCC-platform. Another advantage was that the OCC-platform was tested in the home environments of the frail older adults.
The overall prospect is that an OCC-platform can contribute to the social participation and the self-management competencies of frail older adults, as well as with their social cohesion in the community. In order to validate these prospects, further research is needed on the characteristics and the impact of online platforms .
The authors would like to thank the Zuyderland Hospital for their assistance regarding the inclusion of the participants and to ARISTOCO and 4WebCOM for developing the online community care platform.
The funding for this study was provided by the National Programme for Elderly Care (NPO) which is part of The Netherlands Organisation for Health Research and Development (ZonMw). Funding was also provided by Zuyd University of Applied Sciences. Both funding bodies had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The data is available and it can be obtained from the Centre of Innovative Care and Technology (EIZT), Zuyd University of Applied Sciences, Henri Dunantstraat 2, 6419 PB, Heerlen, The Netherlands.
The authors SW, GC, and YPM made contributions to the data acquisitions, the data analyses, and the interpretation of the data. SW, GC, YPM, ER, MS and LW were involved in drafting and revising the manuscript and they gave their final approval of the version to be published. They also agreed to be accountable for all aspects of the work.
Ethics approval and consent to participate
The ethical principles that are outlined in the Dutch “Medical Research Involving Human Subjects Act” were followed throughout the development process. After informing them, all participants gave their informed and written consent to participate in the study. No formal IRB approval was needed in view of the non-invasive character of the study (https://www.zuyderland.nl/zuyderland/bestuur-en-organisatie/metc-z/).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Schoot Rvd. Hervorming van zorg en ondersteuning: de vertaling van de transities binnen de gemeente. Vilans 2014.Google Scholar
- Santos-Eggimann B, Cuénoud P, Spagnoli J, Junod J. Prevalence of frailty in middle-aged and older community-dwelling Europeans living in 10 countries. J Gerontol Ser A Biol Med Sci. 2009;64A(6):675–81.View ArticleGoogle Scholar
- Morley JE, Vellas B, van Kan GA, Anker SD, Bauer JM, Bernabei R, et al. Frailty consensus: a call to action. J Am Med Dir Assoc. 2013;14(6):392–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Horst Avd, F. VE, De Jong JD. Trends in gezondheid en zorg. Den Haag: Centraal Planbureau 2011.Google Scholar
- Tappenden P, Campbell F, Rawdin A, Wong R, Kalita N. The clinical effectiveness and cost-effectiveness of home-based, nurse-led health promotion for older people: a systematic review. Health Technol Assess. 2012;16(20):1–72.View ArticlePubMedPubMed CentralGoogle Scholar
- UK Department of Health. Whole system demonstrator programme: Headline findings – December 2011. UK; 2011.Google Scholar
- Man YP, Cremers G, Spreeuwenberg M, de Witte L. Platform for frail elderly people supporting information and communication. Stud Health Technol Inform. 2015;217:311–8.PubMedGoogle Scholar
- Al-Shorbaji N. Is there and do we need evidence on eHealth interventions? IRBM. 2013;34(1):24–7.View ArticleGoogle Scholar
- Demiris G. The diffusion of virtual communities in health care: concepts and challenges. Patient Educ Couns. 2006;62(2):178–88.View ArticlePubMedGoogle Scholar
- van der Eijk M, Faber MJ, Aarts JW, Kremer JA, Munneke M, Bloem BR. Using online health communities to deliver patient-centered care to people with chronic conditions. J Med Internet Res. 2013;15(6):e115.View ArticlePubMedPubMed CentralGoogle Scholar
- Shah SG, Robinson I, AlShawi S. Developing medical device technologies from users' perspectives: a theoretical framework for involving users in the development process. Int J Technol Assess Health Care. 2009;25(4):514–21.View ArticlePubMedGoogle Scholar
- Gulliksen J, Göransson B, Boivie I, Blomkvist S, Persson J, Cajander Å. Key principles for user-centred systems design. Behav Inform Technol. 2003;22(6):397–409.View ArticleGoogle Scholar
- Cockburn A. Introduction to use cases. Writing effective use cases. Reading, MA. : Addison-Wesley; 2001.Google Scholar
- Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.View ArticlePubMedGoogle Scholar
- Makai P, Perry M, Robben SH, Schers H, Heinen M, Olde Rikkert MG, et al. Which frail older patients use online health communities and why? A mixed methods process evaluation of use of the health and welfare portal. J Med Internet Res. 2014;16(12):e278.View ArticlePubMedPubMed CentralGoogle Scholar
- Makai P, Perry M, Robben SH, Schers HJ, Heinen MM, Olde Rikkert MG, et al. Evaluation of an eHealth intervention in chronic care for frail older people: why adherence is the first target. J Med Internet Res. 2014;16(6):e156.View ArticlePubMedPubMed CentralGoogle Scholar
- Robben SH, Perry M, Huisjes M, van Nieuwenhuijzen L, Schers HJ, van Weel C, et al. Implementation of an innovative web-based conference table for community-dwelling frail older people, their informal caregivers and professionals: a process evaluation. BMC Health Serv Res. 2012;12:251.View ArticlePubMedPubMed CentralGoogle Scholar
- Krijgsman J, Swinkels I, Lettow Bv, Jong Jd, out K, Friele R, et al. Meer dan techniek: eHealth-monitor 2016. 2016.Google Scholar