フレクトのクラウドblog re:newal

http://blog.flect.co.jp/cloud/からさらに引っ越しています

Manipulate AR objects using UI Gesture and Hand Gesture

This is Shuochen Wang from R&D department in Flect. In this blog I am going to explain how to move AR objects by both translation and rotation using UI Gesture and Hand Gesture.

Table of contents

  • Introduction
    • Why do we need to learn about AR?
    • Why use Apple for AR apps?
    • What is the difference between VR, MR and AR?
    • What is ARKit?
    • What is SceneKit?
    • What is UI Gesture?
    • What is Hand Gesture?
  • Start Up
    • Setting up the view
    • Adding AR objects
  • Setting up UI Gesture recognizers
    • Setting up the Pan Gesture for Translation
    • Setting up the Rotation Gesture for Rotation
  • Setting up Hand Gesture
    • Setting up Hand Gesture for Translation
    • Setting up Hand Gesture for Rotation
  • Conclusion
  • Reference

Introduction

Why do we need to learn about AR?

The need to learn about AR (Augmented Reality) has become more important than ever. In 2020, AR has disappeared from Gartner’s Hype Cycle. This means

AR has reached maturity and became an industry-proofed technology that executives can safely invest in to improve and innovate their business.(AR Post)[^1]

In other words, AR is going to be an essential technology to be used behind other new, trending technologies. As a software developer/ engineer, one needs to learn how to use AR.

続きを読む

価格の最適化に関する論文の紹介: Price Investment using Prescriptive Analytics and Optimization in Retail

こんにちは.研究開発室の福井です.

現在,研究開発室ではリモートコミュニケーションと自動化をメインテーマとして研究開発を行っております.その中でも私は自動化の役に立ちそうな技術に関する研究を行っております.より詳細に言いますと,最近はオペレーションズ・リサーチ(OR)と呼ばれる分野に含まれるいくつかの問題に関して研究を行っています.今回の記事では,最近私が勉強中の価格の最適化に関する問題に関連した論文を紹介させていただきます.

今回は,KDD2020 で発表された以下の論文を紹介します.

  • Mehrotra, Prakhar, et al. "Price Investment using Prescriptive Analytics and Optimization in Retail." Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2020.

この論文では,Walmart(アメリカの大手スーパーマーケットチェーン)において実験的に利用されている,機械学習と OR (の数理計画問題)を用いて利益が最大化するような最適価格を推薦するシステム(Price Recommender System; PRS)について紹介されています.

続きを読む

Building a Slack bot using Google Dialogflow

This is Shuochen Wang from R&D department in Flect. In this blog I am to explain how I implemented a Slack bot using Google Dialogflow.

Table of contents

  • Introduction
    • Why do we need chatbot?
  • Design brief
    • Purpose of the Slack bot
    • The process
    • Why choose Google Dialogflow? (Figure 1 step 3 and 7)
    • Why use external API?
    • What kind of external API? (Figure 1 step 5)
    • Why choose Google for webhook? (Figure 1 step 4 and 6)
  • Cloud Run script specifics
    • Libraries/modules to be used
    • Setting up the main web application
    • Setting up the app route
    • Setting up the request handler
    • Setting up the fallback handler
    • Setting the interactive button for Slack
    • Setting the return message function
  • Conclusion and future work
  • Reference

Introduction

Why do we need chatbot?

According to a new market report pertaining to the global chatbot market published by Transparency Market Research the global chatbot market was valued at US$ 274.5 Mn in 2019 and is projected to reach US$ 2,358.2 Mn by 2027, at a CAGR of 31.3% during the forecast period from 2020 to 2027[^1]. Since the outbreak of the corona virus, the need for automatic chat support is greater than ever before.

続きを読む

Microsoft AzureでSpring Boot製バッチを動かすために(2)

こんにちは。クラウドインテグレーション事業部の上原です。

前回の記事では、とりあえず Azure上でバッチ処理を動かすためにシンプルな構成を作ってみました。

cloud.flect.co.jp

しかしシンプルゆえに問題点も多かったので、少しずつ改善していきましょう。
今回は必要なときだけバッチが稼働する構成 、いわゆるサーバレスアーキテクチャを検討してみます。

続きを読む

AR map base on Twitter tweets

研究開発室の馮 志聖(マイク)です。

Content

  • Introduction
  • ARKit + Core Location + Twitter API
  • Demo
  • Conclusion
  • Other
  • Reference

Introduction

In the era when social media is prevalent, there are various types of content. Some of the content includes location information, such as events, news.... Displaying these location-containing content on the map is convenient for other users to find and read, but they are generally in 2D. Based on flat maps, we will use the latest AR technology combined with 3D maps to present these content including locations, which will bring users a greater experience.

We will develop the Twitter AR map.

Why we choose Twitter?

This chart shows the recent market share of social media in Japan, updated in January 2021.

f:id:fengchihsheng:20210203144724p:plain
Social media stats in Japan until January 2021.

For details, please refer to the link below.

https://gs.statcounter.com/social-media-stats/all/japan

From this chart, we can see that the ratio of Twitter is 59%, nearly half of the market share, so we choose Twitter.

This information get from statcounter GlobalStats.

https://gs.statcounter.com/

続きを読む

Amazon Chime SDKのアプリケーションにBGM/SE機能を追加する

こんにちは。研究開発室の岡田です。

前回の記事では、Amazon Chime SDK for JS1のVoice Focusを用いてノイズ除去を行う方法をご紹介しました(参照)。今回は、さらに発展させてノイズ除去をした後、BGMやSEを追加する方法をご紹介します。これまでに何度かご紹介してきた仮想背景の音声版といったところでしょうか。

作るものは下の動画のようなものになります。大雨の中で講義をしている動画に対して、雨の音の代わりに宇宙っぽいBGMを追加しています(00:16-)。併せて背景を変えてあげれば、大雨の中にいた人があっという間に宇宙で話をしている状況に変わります。 https://www.youtube.com/watch?v=awfXdqRoC6I


Amazon Chime SDK for Javascript, noise suppression and sound mixing test

なお、今回はAmazon Chime SDKのノイズ除去機能であるVoice Focusの詳細については説明を行いません。前回の記事をご参照ください(参照)。


  1. Amazon Chime SDK for JSはAmazonが提供するビデオ会議システムをWebアプリに組み込むためのSDK

続きを読む

AR Remote Instructions base on ARKit

研究開発室の馮 志聖(マイク)です。

Content

  • Background
  • Abstract
  • Twilio version
  • ARWorldMap version
  • Real-time DB version
  • Conclusion
  • Other
  • Reference

Background

The coronavirus is ruthlessly eroding human lives, and many people work from home for safety reasons.

Remote work has become very common, among which video chat tools have become a popular focus. However, video chat tools have limitations and cannot be used for certain types of tasks, such as the inability to effectively point out the location when performing maintenance tasks.

Our goal is to improve this limitation and make remote work more convenient, so we will develop an AR Remote Instructions program.

続きを読む