Welcome to new things

[Technical] [Electronic work] [Gadget] [Game] memo writing

Memo for a slightly elaborate use of BigQuery (etc.)

I usually use Google BigQuery only for simple aggregate SQL, but there are many other useful functions besides aggregate SQL. However, since I don't use it often and when I do try to use it, I start by looking for a manual, so I'll put tog…

Difference between "dimensions" and "measures" in BI tools

The first time I used a BI tool, I was confused by the difference between "dimensions" and "measures. I will try to briefly explain the differences and ideas here. name In Tableau, they are called "dimensions" and "measures". In PowerBI, t…

How to use Microsoft SQL Server with JavaScript

This is a memo on how to use Microsoft SQL Server (MSSQL) with JavaScript. The library is tedious, which is also recommended by Microsoft. tedios is a callback style library, but it is written in async, await, and TypeScript in a modern st…

How to use Go language (string, byte, rune)

You will always find string, byte, and rune in introductory Go language books. However, when you start to program, the frequent interconversions between each of them can be confusing. In such cases, we tend to somehow convert the type and …

How to use "relative date" and "date range" at the same time in Tableau

To the UI for specifying the display range of time series graphs The default is to show the most recent X days, and you can specify any date in the calendar when you need it." I often see things like this. But I can't do the equivalent wit…

Using Firestore as a lightweight database

I was working on a program related to GCP and wanted to store some data. It was a one-off piece of data that was not large enough to set up a database, nor was it likely to write a join query between the data. To begin with, setting up a d…

A note on a slightly more elaborate use of BigQuery (scheduled queries)

I usually use Google BigQuery only for simple aggregate SQL, but there are many other useful functions besides aggregate SQL. However, since I don't use it often and when I do try to use it, I start by looking for a manual, so I'm going to…

Notes on a slightly more elaborate use of BigQuery (programming)

I usually use Google BigQuery only for simple aggregate SQL, but there are many other useful functions besides aggregate SQL. However, since I don't use it often and when I do try to use it, I start by looking for a manual, so I'll put tog…

Memo for slightly elaborate usage of BigQuery (table creation and data update)

I usually use Google BigQuery only for simple aggregate SQL, but there are many other useful functions besides aggregate SQL. However, since I don't use it often and when I do try to use it, I start by looking for a manual, so I'll put tog…

Memo on how to use BigQuery in a slightly more elaborate way (views, materialized views, table functions)

I usually use Google BigQuery only for simple aggregate SQL, but there are many other useful functions besides aggregate SQL. However, since I don't use it often and when I do try to use it, I start by looking for a manual, so I'll put tog…

Memo on how to use the Markdown parser remark

I have read Markdown, edited it in various ways as I wanted, and wanted to output it to Markdown again. I used a JavaScript Markdown parser called remark. However, it is difficult to understand how to use it, and I am sure I will forget ho…

File drop with Selenium, puppeteer, and Playwright

For some time now, we have been putting together a list of how to use Selenium, puppeteer, and Playwright. Since the summary is getting long, I will put the operations that require some explanation and procedures in a separate article. Her…

Infinite scrolling with Selenium, puppeteer and Playwright

For a while now, I have been putting together a list of how to use Selenium, puppeteer, and Playwright. Since the summary is getting long, I will put the operations that require some explanation and procedures in a separate article. Here i…

Notes on how to use puppeteer

I had previously tested both Selenium and Playwright for comparison. Now that I've learned how to use them, I've compiled a brief summary of how to use them in the following article so that I can quickly recall them when I need to use them…

I want to handle JavaScript arrays in SQL.

I usually use SQL, but when I am working with array data in JavaScript, I sometimes wish I could write queries in SQL for JavaScript arrays. On the other hand, C# has a language called LINQ that can process arrays with SQL-like queries. Th…

Notes on how to use Playwright

Since I have been experimenting with Playwright recently, I thought I would make a note of how to use Playwright so that I can remember how to use it again if I forget how to use it. install npm install --save playwright When Playwright is…

Selenium Usage Notes

Since I have been experimenting with Selenium recently, I thought I would make a note of how to use Selenium so that if I forget how to use it, I can remember again. install Selenium pip install selenium The browser and the WebDriver that …

Sort Excel worksheets by name

I had the opportunity to work with Excel, which has hundreds of worksheets, and I tried to sort the worksheets by name because it was difficult to find the desired sheet. But Excel doesn't have the ability to sort worksheets by name. I end…

I thought the Generics of the Go language was not relevant to me, but it was essential.

Generics has been included since version 1.18 of the Go language. To the extent that I use the Go language, I thought I would never use Generics because I don't write generic functions and the function descriptions are long. Useful feature…

Using Return Values in Shell Script Functions

I was using shell scripts and the scripts were getting long and hard to read, so I tried to summarize them with functions. However, the return values of shell script functions are different from those of functions in other programming lang…

How to remember SQL window functions (analysis functions)

When I started learning SQL, the window functions (analytic functions) were the most difficult to understand. Although you do not need to use the window function when using a database simply as a place to store and retrieve data, it is a v…

How to call REST APIs with a service account on Google Cloud Platform

Normally, GCP operations can be done via command line tools or client libraries, so we never called the REST API directly. I'm trying out a service called GCP Batch right now, but it's still in preview stage and the command line tools and …

How to encode and decode URLs with shell scripts

This is a memo on how to encode and decode URLs with shell scripts. You can find many ways to do this by searching. https://stackoverflow.com/questions/296536/how-to-urlencode-data-for-curl-command At first, we tried using nkf for both enc…

How to sort search results in Confluence Cloud

How to sort search results in Confluence Cloud by update order, title order, or any other criteria. Advanced Search When you click on the search window in the upper right corner of Confluence, you will see the "Advanced Search in Confluenc…

How to create sequential number and calendar tables in AWS Redshift

I have not used Redshift for the past few years, having migrated from AWS Redshift to Google BigQuery. However, Redshift Serverless, which is a pay-as-you-go Redshift, finally appeared and I started to get curious about it. Sure enough, I …

I was wrong about JavaScript Promise being an asynchronous function.

I learned from the following article that Promise in JavaScript is called synchronously. https://zenn.dev/yuhua_shi/articles/331569ef2fe886 I assumed that functions passed to Promise were asynchronous functions. Below is a summary of the P…

Estimate a flat rate for BigQuery.

Since Google BigQuery is pay-as-you-go and relatively inexpensive, I had been using it without much concern about the fees. Big data analysis was a breakthrough in that matters that until now could only be guessed at could actually be expr…

Thoughts on using both Selenium and Playwright

I use Puppeteer for web crawling. I had hoped to someday put together a guide on how to use Puppeteer, but in the meantime, I have been hearing a lot about Playwright as a browser manipulation tool similar to Puppeteer. Then I started thin…

Create a site loosely with Chakra UI

When creating a sample site using React, you may want to create it quickly and easily by combining existing settings without thinking too much about the site design. We usually use UI Fabric (now Fluent UI), which is used by Microsoft Offi…

Memo on how to create a minimal authentication site with AWS Amplify + React

I wanted to create a React site with an authentication function easily, but I gave up because it was too much trouble to build a backend each time. However, we tried AWS Amplify to see if we could easily build a backend. Since I have tried…