Abstract

User experience (UX) analysis is essential for designers and companies when optimizing products or services as it can help designers to uncover valuable information, such as the hedonic and pragmatic qualities of a UX. While previous research has described the conventional methods of UX analysis, such as surveys or subjective determination, this paper proposes a data-driven methodology to automatically integrate hedonic and pragmatic qualities for UX from online customer reviews. The proposed methodology comprises the following steps. First, we combined a corpus-based approach, a dictionary-based approach and word embedding to generate a lexicon of hedonic and pragmatic qualities. Second, we filtered out the sentences that contained no hedonic or pragmatic information and classified the remaining review sentences. Third, we extracted and clustered the UX elements (such as product feature, context information and context clustering). Finally, we scored each UX element based on hedonic or pragmatic qualities and compared it against previous UX modeling. This study integrates hedonic and pragmatic qualities to enrich UX modeling in the field of UX. For a product designer, the UX analysis results may highlight a requirement to optimize product design. It may also represent a potential market opportunity in a UX state where most of the current products are perceived UX results by customers. This research also examines the invaluable relationship between UX and online customer reviews to support the prospective planning of customer strategy and design activities.

References

1.
Pucillo
,
F.
, and
Cascini
,
G.
,
2014
, “
A Framework for User Experience, Needs and Affordances
,”
Des. Stud.
,
35
(
2
), pp.
160
179
.
2.
Lin
,
C. J.
, and
Cheng
,
L.-Y.
,
2017
, “
Product Attributes and User Experience Design: How to Convey Product Information Through User-Centered Service
,”
J. Intell. Manuf.
,
28
(
7
), pp.
1743
1754
.
3.
Hassenzahl
,
M.
,
2008
, “
User Experience (UX) Towards an Experiential Perspective on Product Quality
,”
Proceedings of the 20th Conference on L'Interaction Homme-Machine
,
Metz France
,
Sept. 2–5
, pp.
11
15
.
4.
Law
,
E. L.-C.
,
Roto
,
V.
,
Hassenzahl
,
M.
,
Vermeeren
,
A. P.
, and
Kort
,
J.
,
2009
, “
Understanding, Scoping and Defining User Experience: a Survey Approach
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
Boston, MA
,
Apr. 4–9
, pp.
719
728
.
5.
Diefenbach
,
S.
,
Kolb
,
N.
, and
Hassenzahl
,
M.
,
2014
, “
The'hedonic'in Human-Computer Interaction: History, Contributions, and Future Research Directions
,”
Proceedings of the 2014 Conference on Designing Interactive Systems
,
Vancouver BC Canada
,
June 21–25
, pp.
305
314
.
6.
Hassenzahl
,
M.
,
2004
, “
The Interplay of Beauty, Goodness, and Usability in Interactive Products
,”
Hum. Comput. Interact.
,
19
(
4
), pp.
319
349
.
7.
Ahmad
,
S. N.
, and
Laroche
,
M.
,
2017
, “
Analysing Electronic Word of Mouth: A Social Commerce Construct
,”
Int. J. Inf. Manage.
,
37
(
3
), pp.
202
213
.
8.
Zhan
,
J.
,
Loh
,
H. T.
, and
Liu
,
Y.
,
2009
, “
Gather Customer Concerns From Online Product Reviews–A Text Summarisation Approach
,”
Expert Syst. Appl.
,
36
(
2
), pp.
2107
2115
.
9.
Chen
,
Z.
,
Ma
,
N.
, and
Liu
,
B.
,
2015
, “
Lifelong Learning for Sentiment Classification
,”
The 53rd Annual Meeting of the Association for Computational Linguistics and The 7th International Joint Conference of the Asian Federation of Natural Language Processing
,
Beijing, China
,
July 27–31
, pp.
750
756
.
10.
He
,
W.
,
2013
, “
Improving User Experience With Case-Based Reasoning Systems Using Text Mining and Web 2.0
,”
Expert Syst. Appl.
,
40
(
2
), pp.
500
507
.
11.
Tong
,
Y.
,
Liang
,
Y.
,
Liu
,
Y.
,
Hicks
,
Y.
, and
Spasic
,
I.
,
2021
, “
Integrating Hedonic Quality for User Experience Modelling
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC-CIE 2021
,
Virtual, Online
,
Aug. 17–19
,
p. V002T02A052
.
12.
Yang
,
B.
,
Liu
,
Y.
,
Liang
,
Y.
, and
Tang
,
M.
,
2019
, “
Exploiting User Experience From Online Customer Reviews for Product Design
,”
Int. J. Inf. Manage.
,
46
, pp.
173
186
.
13.
Merčun
,
T.
, and
Žumer
,
M.
,
2017
, “
Exploring the Influences on Pragmatic and Hedonic Aspects of User Experience
”.
14.
Hassenzahl
,
M.
,
2003
,
Funology. Human–Computer Interaction Series
, Vol.
3
,
Springer
,
Dordrecht
, pp.
31
42
.
15.
Minge
,
M.
,
2008
, “
Dynamics of User Experience
,”
Proceedings of the Workshop on Research Goals and Strategies for Studying User Experience and Emotion, NordiCHI
,
Lund, Sweden
,
Oct. 20–22
.
16.
Minge
,
M.
,
Thüring
,
M.
, and
Wagner
,
I.
,
2016
, “
Developing and Validating an English Version of the meCUE Questionnaire for Measuring User Experience
,”
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
,
60
(
1
), pp.
2063
2067
.
17.
Hassenzahl
,
M.
,
Platz
,
A.
,
Burmester
,
M.
, and
Lehner
,
K.
,
2000
, “
Hedonic and Ergonomic Quality Aspects Determine a Software's Appeal
,”
CHI00: Human Factors in Computing Systems
,
The Hague The Netherlands
,
Apr. 1–6
, pp.
201
208
.
18.
Hassenzahl
,
M.
,
2001
, “
The Effect of Perceived Hedonic Quality on Product Appealingness
,”
Int. J. Hum-Comput. Int.
,
13
(
4
), pp.
481
499
.
19.
Laugwitz
,
B.
,
Held
,
T.
, and
Schrepp
,
M.
,
2008
, “
Construction and Evaluation of a User Experience Questionnaire
,”
Symposium of the Austrian HCI and Usability Engineering Group
,
Springer, Berlin/Heidelberg
,
Nov. 20–21
, pp.
63
76
.
20.
Ströckl
,
D. E.
,
Oberrauner
,
E.
,
Krainer
,
D.
,
Wohofsky
,
L.
, and
Oberzaucher
,
J.
,
2020
, “
Hedonic and Pragmatic Qualities of AAL Pilot Region Technologies: Evaluation with the AttrakDiff Survey
,”
Proceedings of the 6th International Conference on Information and Communication Technologies for Ageing Well and e-Health
,
Prague, Czech Republic
,
May 3–5
, pp.
187
193
.
21.
Maier
,
A.
, and
Berry
,
D. M.
,
2017
, “
Improving the Identification of Hedonic Quality in User Requirements—a Controlled Experiment
,”
2017 IEEE25th International Requirements Engineering Conference (RE)
,
Lisbon, Portugal
,
Sept. 4–8
, pp.
213
222
.
22.
von Wilamowitz-Moellendorff
,
M.
,
Hassenzahl
,
M.
, and
Platz
,
A.
,
2006
, “
Dynamics of User Experience: How the Perceived Quality of Mobile Phones Changes Over Time
,”
User Experience-Towards a Unified View, Workshop at the 4th Nordic Conference on Human-Computer Interaction
,
Oslo, Norway
,
Oct. 14–18
, pp.
74
78
.
23.
Ferreira
,
D.
,
Melo
,
T.
, and
Nogueira
,
T.
,
2020
, “
Unveiling Usability and UX Relationships for Different Gender, Users Habits and Contexts of Use
,”
J. Web Eng.
,
19
(
5–6
), pp.
799
817
.
24.
Hazlett
,
R. L.
, and
Benedek
,
J.
,
2007
, “
Measuring Emotional Valence to Understand the User's Experience of Software
,”
Int. J. Hum-Comput. Stud.
,
65
(
4
), pp.
306
314
.
25.
Hassenzahl
,
M.
,
Diefenbach
,
S.
, and
Göritz
,
A.
,
2010
, “
Needs, Affect, and Interactive Products–Facets of User Experience
,”
Interact. Comput.
,
22
(
5
), pp.
353
362
.
26.
Kujala
,
S.
,
Roto
,
V.
,
Väänänen-Vainio-Mattila
,
K.
,
Karapanos
,
E.
, and
Sinnelä
,
A.
,
2011
, “
UX Curve: A Method for Evaluating Long-Term User Experience
,”
Interact. Comput.
,
23
(
5
), pp.
473
483
.
27.
Jin
,
J.
,
Liu
,
Y.
,
Ji
,
P.
, and
Kwong
,
C.
,
2019
, “
Review on Recent Advances in Information Mining From big Consumer Opinion Data for Product Design
,”
ASME J. Comput. Inf. Sci. Eng.
,
19
(
1
), p.
010801
.
28.
Jin
,
J.
, and
Liu
,
Y.
,
2010
, “
How to Interpret the Helpfulness of Online Product Reviews: Bridging the Needs Between Customers and Designers
,”
Proceedings of the 2nd International Workshop on Search and Mining User-Generated Contents
,
Toronto, ON, Canada
,
Oct. 30
, pp.
87
94
.
29.
Dave
,
K.
,
Lawrence
,
S.
, and
Pennock
,
D. M.
,
2003
, “
Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews
,”
Proceedings of the 12th International Conference on World Wide Web
,
New York
,
May 20–24
, pp.
519
528
.
30.
Ding
,
X.
,
Liu
,
B.
, and
Zhang
,
L.
,
2009
, “
Entity Discovery and Assignment for Opinion Mining Applications
,”
Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
,
New York
,
June 28–July 1
, pp.
1125
1134
.
31.
Wang
,
H.
,
Lu
,
Y.
, and
Zhai
,
C.
,
2010
, “
Latent Aspect Rating Analysis on Review Text Data: A Rating Regression Approach
,”
Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
,
New York
,
July 25–28
, pp.
783
792
.
32.
Dahiya
,
A.
,
Gautam
,
N.
, and
Gautam
,
P. K.
,
2021
, “
Data Mining Methods and Techniques for Online Customer Review Analysis: A Literature Review
,”
J. Syst. Manag. Sci.
,
11
(
3
), pp.
1
26
.
33.
Popescu
,
A.-M.
, and
Etzioni
,
O.
,
2007
,
Natural Language Processing and Text Mining
,
Springer
,
London
, pp.
9
28
.
34.
Suryadi
,
D.
, and
Kim
,
H. M.
,
2019
, “
A Data-Driven Approach to Product Usage Context Identification From Online Customer Reviews
,”
ASME J. Mech. Des.
,
141
(
12
), p.
121104
.
35.
Pelleg
,
D.
, and
Moore
,
A. W.
,
2000
, “
X-means: Extending k-Means With Efficient Estimation of the Number of Clusters
,”
ICML
,
Stanford, CA
,
June 29–July 2
,
Vol. 1, pp. 727–734
.
36.
Brill
,
E.
, and
Marcus
,
M.
,
1992
,
Automatically Acquiring Phrase Structure Using Distributional Analysis
,
Pennsylvania University
,
Philadelphia
.
37.
Losee
,
R. M.
,
2001
, “
Natural Language Processing in Support of Decision-Making: Phrases and Part-of-Speech Tagging
,”
Inf. Process. Manage.
,
37
(
6
), pp.
769
787
.
38.
He
,
R.
,
Lee
,
W. S.
,
Ng
,
H. T.
, and
Dahlmeier
,
D.
,
2018
, “
Exploiting Document Knowledge for Aspect-Level Sentiment Classification
,” arXiv preprint arXiv:1806.04346.
39.
Ramachandran
,
P.
,
Liu
,
P. J.
, and
Le
,
Q. V.
,
2016
, “
Unsupervised Pretraining for Sequence to Sequence Learning
,” arXiv preprint arXiv:1611.02683.
40.
Liu
,
J.
, and
Zhang
,
Y.
,
2017
, “
Attention Modeling for Targeted Sentiment
,”
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics
,
Valencia, Spain
,
Apr. 3
,
Vol. 2, pp. 572–577
.
41.
Liu
,
Y.
, and
Loh
,
H. T.
,
2007
, “
Corpus Building for Corporate Knowledge Discovery and Management: A Case Study of Manufacturing
,”
International Conference on Knowledge-Based and Intelligent Information and Engineering Systems
,
Vietri sul Mare, Italy
,
Sept. 12–14
, pp.
542
550
.
42.
Jones
,
K. S.
, and
Willett
,
P.
,
1997
,
Readings in Information Retrieval
,
Morgan Kaufmann
,
San Francisco, CA
.
43.
Manning
,
C.
, and
Schutze
,
H.
,
1999
,
Foundations of Statistical Natural Language Processing
,
MIT Press
,
Cambridge, MA
.
44.
Chollet
,
F.
,
2015
,
Keras: Deep Learning Library for Theano and Tensorflow, https://keras.io/, Accessed April 19, 2017
.
45.
Pennington
,
J.
,
Socher
,
R.
, and
Manning
,
C. D.
,
2014
, “
Glove: Global Vectors for Word Representation
,”
Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
,
Doha, Qatar
,
October
, pp.
1532
1543
.
46.
Engl
,
S.
, and
Nacke
,
L. E.
,
2013
, “
Contextual Influences on Mobile Player Experience–A Game User Experience Model
,”
Entertain. Comput.
,
4
(
1
), pp.
83
91
.
You do not currently have access to this content.